-- Logs begin at Tue 2022-05-24 12:16:11 UTC, end at Tue 2022-05-24 13:20:27 UTC. -- May 24 12:44:39.808555 dv-cinder-843018-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 24 12:44:39.815964 dv-cinder-843018-2-smb devstack@keystone.service[80154]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 12:44:39 2022] *** May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: nodename: dv-cinder-843018-2-smb May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: machine: x86_64 May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: clock source: unix May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: pcre jit disabled May 24 12:44:39.817961 dv-cinder-843018-2-smb devstack@keystone.service[80154]: detected number of CPU cores: 4 May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: current working directory: / May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: detected binary path: /usr/bin/uwsgi-core May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: your processes number limit is 47680 May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: your memory page size is 4096 bytes May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: detected max file descriptor number: 2048 May 24 12:44:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80154]: lock engine: pthread robust mutexes May 24 12:44:39.820389 dv-cinder-843018-2-smb devstack@keystone.service[80154]: thunder lock: enabled May 24 12:44:39.820389 dv-cinder-843018-2-smb devstack@keystone.service[80154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 24 12:44:39.820389 dv-cinder-843018-2-smb devstack@keystone.service[80154]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 12:44:39.865442 dv-cinder-843018-2-smb devstack@keystone.service[80154]: Python main interpreter initialized at 0x556371ac09c0 May 24 12:44:39.865442 dv-cinder-843018-2-smb devstack@keystone.service[80154]: python threads support enabled May 24 12:44:39.865442 dv-cinder-843018-2-smb devstack@keystone.service[80154]: your server socket listen backlog is limited to 100 connections May 24 12:44:39.865442 dv-cinder-843018-2-smb devstack@keystone.service[80154]: your mercy for graceful operations on workers is 90 seconds May 24 12:44:39.865801 dv-cinder-843018-2-smb devstack@keystone.service[80154]: mapped 403077 bytes (393 KB) for 2 cores May 24 12:44:39.865874 dv-cinder-843018-2-smb devstack@keystone.service[80154]: *** Operational MODE: preforking *** May 24 12:44:39.866150 dv-cinder-843018-2-smb devstack@keystone.service[80154]: *** uWSGI is running in multiple interpreter mode *** May 24 12:44:39.866150 dv-cinder-843018-2-smb devstack@keystone.service[80154]: spawned uWSGI master process (pid: 80154) May 24 12:44:39.866356 dv-cinder-843018-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 24 12:44:39.867429 dv-cinder-843018-2-smb devstack@keystone.service[80154]: spawned uWSGI worker 1 (pid: 80161, cores: 1) May 24 12:44:39.867429 dv-cinder-843018-2-smb devstack@keystone.service[80154]: spawned uWSGI worker 2 (pid: 80162, cores: 1) May 24 12:44:39.867429 dv-cinder-843018-2-smb devstack@keystone.service[80154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 12:44:45.534533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:44:45.534533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: from cryptography.utils import int_from_bytes May 24 12:44:45.535319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:44:45.535319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: from cryptography.utils import int_from_bytes May 24 12:44:45.580788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:44:45.580788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: from cryptography.utils import int_from_bytes May 24 12:44:45.581302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 12:44:45.581302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: from cryptography.utils import int_from_bytes May 24 12:44:45.584817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:44:45.585014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:44:45.585209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] command line args: [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:44:45.585480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:44:45.585659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ================================================================================ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:44:45.585921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] admin_token = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.586193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] config_dir = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.586383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.586565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] config_source = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.586747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] debug = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.586959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_config_append = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_dir = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.588911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.589097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.589334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.589581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.589829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.590026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.590221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.590470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.590717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.590952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.591187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.591422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.591657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.591906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.592152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.592426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.593135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.593444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] publish_errors = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.593821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.594201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.594397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.594653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.594894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.595131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] standard_threads = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.595366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.595612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.595791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.595969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] use_journal = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.596144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] use_json = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.596321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] use_stderr = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.596497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] use_syslog = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.596729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.596987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.597227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.597488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.597727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.597978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.598245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.598497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.598734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.598982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.599231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.599484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.599722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.599969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.600207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.600456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.600705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.600943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.601198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.601452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.601698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.601934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.602215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.602484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.602739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.602989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.603223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.603456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.603687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.603922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.604177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.604424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.604656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.604887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.605136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.605385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.605625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.605873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.606106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.606372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.606608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.606841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.607072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.607302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.607533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.607770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.608033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.608248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.609173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.609452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.609691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.609930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.610204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.610440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.610680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.610921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.611160 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.611398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.611638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.611868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.612117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.612353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.612590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.612822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.613083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.613323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.613556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.613795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.614040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.614335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.614575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.614824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.615072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.615321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.615558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.615793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.616042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.616281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.616518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.616763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.617002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.617241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.617477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.617715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.617952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.618239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.618485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.618728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.618966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.619208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.619445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.619683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.619919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.620149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.620379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.620609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.620844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.621075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.621316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.621550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.621809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.622047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.622332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.622595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.622838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.623072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.external = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.623304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.623602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.623834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.624647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.password = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.624880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] auth.token = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.625121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.625357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.625604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.625836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.626083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.626357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.626591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.626827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.627074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.627323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.627572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.627810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.628056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.628290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.628554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.628809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.629046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.629300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.629495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 12:44:45.629575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.629692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 12:44:45.629819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.629895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] command line args: [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 12:44:45.630082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.630229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 12:44:45.630330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ================================================================================ {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 12:44:45.630406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.630585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] admin_token = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.630661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.630828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.630906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] config_dir = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.631197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] config_source = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.631388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] debug = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.631636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.631870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.631968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.632045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.632225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.632300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.632475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.632581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.632704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.632803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.632899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_config_append = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.633009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.633106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.633200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_dir = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.633301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.633397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_file = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.633498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.633844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.633942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.634067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.634190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.634347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.634434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.634593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.634683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.634756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.634915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.635008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.635168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.635245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.635414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.635517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.635664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.635876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.635954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.636109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.636221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.636339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.636552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.636637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.636788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.636908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.637021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.637099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.637263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.637511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.637588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.637735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] publish_errors = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.637862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.637999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.638098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.638219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.638297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.638414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.638502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.638634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.638768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.638868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.639010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.639087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] standard_threads = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.639251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.639333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.639483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.639561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.639769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.640002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.640195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.640280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.640382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] use_journal = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.640459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.640561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] use_json = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.640696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.640781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] use_stderr = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.640901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] use_syslog = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.640983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 12:44:45.641212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.641937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.642926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.643877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.644979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.645944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.646992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.647939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.648873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.649972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.650996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.651936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.652862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.653958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.654996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.655145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.655267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.655452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.655802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.655882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.656878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.657984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] role.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] role.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.658991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.659945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.660980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.661872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.662819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.663994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.664999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.665964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.external = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.666930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.password = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] auth.token = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.667890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.668987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.669929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.670765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.671431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.671563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.671836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.672993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.673921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.674932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.675955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.676111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.676190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.676281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:44:45.676358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.676590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.676846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.677085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.677338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.677573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.677821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.678069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.678330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.678565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.678812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.679044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.679282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.679527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.679777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.680008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.680253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.680470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.680711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.680957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.681203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.681457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.681704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.681972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.682239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.682480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.682708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.682945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.683173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.683404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.683643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.683879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.684124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.684354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.684601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.684845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.685076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.685320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.685565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.685795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.686104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.686374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.687184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.687421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.687674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.687918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.688163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.688418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.688668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.688901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.689134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.689385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.689636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.689873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.690120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.690366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.690597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.690838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.691097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.691338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.691585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.691833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.692078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.692313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.692542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.692776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.693010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.693245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.693579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.693835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.694085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.694357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.694607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.694858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.695091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.695342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.695581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.695820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.696060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.696298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.696544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.696791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.697030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.697289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.697519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.697763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.698000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.698260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.698499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.698744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.698988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.699221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.699456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.699695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.699945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.700192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.700429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.700677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.700927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.701161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.701406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.701643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.701880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.702649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] role.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.703383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] role.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.703633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.703891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.704146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.704400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.704652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.704903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.705153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.705403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.705654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.705890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.706159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.706414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.706663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.706911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.707318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.707562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.707647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.707798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.707881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.708025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.708108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.708287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.708537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.708771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.709027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.709279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.709519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.709751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.709985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.710244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.710500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.710756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.711005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.711242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.711477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.711707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.711940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.712177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.712423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.712657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.712912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.713157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.713395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.713638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.713879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.714138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.714382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.714619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.714851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.715094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.715340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.715567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.715808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.716102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.716370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.connection = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.716589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.716681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.716852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.717093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.717351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.717587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.718390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.718635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.718878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.719127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.719367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.719612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.719848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.720095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.720330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.720575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.720805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.721045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.721280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 12:44:45.721493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 12:44:45.745445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.745675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.747031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.747263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.747484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.758513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.777658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.777890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.799631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.817342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.858006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.858266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.862157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.862382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.926782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.926956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.927914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.928067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.928286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.928501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.951486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.951720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.951835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.951916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.951991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.952898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.953045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.953263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.953479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.964255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.964563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.977572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.978959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.979089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.979173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.979300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.979382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.979512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 12:44:45.997685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.997895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 12:44:45.998215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.998303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.998431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 12:44:45.998516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 12:44:45.998701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.998785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.998988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 12:44:45.999119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.999251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.999570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.999751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:45.999827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.000005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.000097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.011308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.011586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.011852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.012131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.012984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.013258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.013518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.013790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.020376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.022359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.023684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.023962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.024241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.024521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.024799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.025056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.025319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.025611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.025694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.025888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.025985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.026187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.026273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.026467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.026549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.026745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.027112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.027379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.027646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.027911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.028181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.028448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.053738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.055500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.055781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.056309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.058021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.058320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.061053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.061331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.062197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.064703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.064979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.065256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.069862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.070171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.072515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.072794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.074723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.075125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.075409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.075690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.075961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.076230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.076496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.076763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.077769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.078187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.078474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.078757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.079033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.079302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.079568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.079831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.095981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.096259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.099329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.099611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.100949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.104269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.104610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.104901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.107927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.108218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.110188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.113767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.113850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.117558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.117650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.117864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.118176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.118463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.118754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.119028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.121327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.121621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.121900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.122200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.122480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.122769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.138965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.139246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.139534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.139845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.143427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.143707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.143971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.144232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.148044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.149769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.150042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.152216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.153119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.153397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.153674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.153919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.154001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.154214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.154298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.158294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.158568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.158842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.159126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.159400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.168640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.168931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.169208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.169485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.169763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.170044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.170350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.173490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.173766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.174043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.174351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.174626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.174901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.175169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.189315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.192556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.194129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.195886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.197353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.197496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.199171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.199456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.199740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.200686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.202802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.204423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.204705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.204987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.207192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.208800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.212122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.212379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.212472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.212958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.213244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.213985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.217221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.217507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.218452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.218928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.222921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.223211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.223593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.228003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.228285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.228663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.231477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.231760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.232038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.232314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.232586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.232866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.233155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.233483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.233753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.234029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.234321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.234582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.234853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.235117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.237068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 12:44:46.237344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.237617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.237887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.238174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.238453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.238720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.239000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.239264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.239536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.239806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.240061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.240326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.240589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 12:44:46.274794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556371ac09c0 pid: 80162 (default app) May 24 12:44:46.278002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dcdcd-489a-4c75-80ba-9d6d90043786 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:46.278322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dcdcd-489a-4c75-80ba-9d6d90043786 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:46.278603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dcdcd-489a-4c75-80ba-9d6d90043786 None None] PATH_INFO: `/v3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:46.281710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556371ac09c0 pid: 80161 (default app) May 24 12:44:46.283520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue May 24 12:44:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:44:54.236575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:54.237140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:54.237140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:54.241593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:44:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:44:54.246812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:54.247245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:54.247376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:54.316012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: INFO dbcounter [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] Registered counter for database keystone May 24 12:44:54.337197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG oslo_db.sqlalchemy.engines [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:44:54.344152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writer thread running {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:44:54.521836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG passlib.handlers.bcrypt [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80162) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 12:44:54.522213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG passlib.handlers.bcrypt [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80162) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 12:44:54.577970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:44:54.579603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:44:54.703550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:44:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 24 12:44:54.751796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:44:54.821679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: INFO dbcounter [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] Registered counter for database keystone May 24 12:44:54.841287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG oslo_db.sqlalchemy.engines [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 12:44:54.848110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writer thread running {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 12:44:54.970031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c334-6d7d-45cf-8c08-85e063c64093 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:44:54.974258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:44:54.974913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:54.975193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:54.975468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:54.983998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:44:55.036630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 12:44:55.036971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33323a6-2147-455b-8e90-36483bea8eac admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:44:55.046779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue May 24 12:44:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 12:44:55.052793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:44:55.067985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0408-e76c-49bf-abdb-bfeca91d7b8a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:44:55.072434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:44:55.073505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:55.073795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:55.074073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] PATH_INFO: `/v3/projects/e6f1e0d8c1cd468ea817eb192b478192` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:55.075628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6f1e0d8c1cd468ea817eb192b478192)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:44:55.233948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING keystone.common.rbac_enforcer.enforcer [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 12:44:55.234318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ab8c5-a233-45d4-af35-97884d0da199 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:44:55.239077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue May 24 12:44:55 2022] GET /identity/v3/projects/e6f1e0d8c1cd468ea817eb192b478192 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:44:57.393631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504331e-fe48-46ef-90b6-37f38bbe9e04 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:57.394171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504331e-fe48-46ef-90b6-37f38bbe9e04 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:57.394264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504331e-fe48-46ef-90b6-37f38bbe9e04 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:57.398393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:44:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:44:57.403787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:57.404197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:57.404361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:57.424578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:44:57.426173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:44:57.433990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:44:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 24 12:44:57.456627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504331e-fe48-46ef-90b6-37f38bbe9e04 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:44:57.469195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504331e-fe48-46ef-90b6-37f38bbe9e04 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:44:57.473368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:44:57.473996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:57.474317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:57.474598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:57.482280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:44:57.484699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a61ef-8ae7-4420-afcf-10b4d79bb0cc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:44:57.493445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue May 24 12:44:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 12:44:57.498864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:44:57.507822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6be0a-1915-42a8-a476-275839988437 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:44:57.512509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:44:57.513367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:57.513654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:57.513929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:57.515407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:44:57.517236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad376-af45-42ce-876a-b920631a17bc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:44:57.518873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue May 24 12:44:57 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:44:59.786473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098476-5558-45f4-afcf-e1d6d0daec53 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:59.786973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098476-5558-45f4-afcf-e1d6d0daec53 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:59.787051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b098476-5558-45f4-afcf-e1d6d0daec53 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:59.788413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:44:59.790547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68add3-d31c-4dc6-b875-084b37515097 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:59.790933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68add3-d31c-4dc6-b875-084b37515097 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:59.791116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68add3-d31c-4dc6-b875-084b37515097 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:59.792526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:44:59.793202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:59.793520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:59.793779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:59.797729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:44:59.798016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:44:59.798323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:44:59.815490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:44:59.816663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:44:59.835207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG passlib.handlers.bcrypt [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80161) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 12:44:59.835633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG passlib.handlers.bcrypt [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80161) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 12:44:59.882571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:44:59.884416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:44:59.898586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:44:59.921298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:44:59.944893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:44:59.985200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:00.008849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.027151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e973b10-13b4-475d-b8c9-c44f6151c149 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.060387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.060974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.061501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.061813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.111249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51deec-9957-4c16-bc6c-026ae7480b54 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.113580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.136784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.138776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.156526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.157580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.157864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.158157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.163044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.170183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:00.181852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:00.182804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:00.183641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:00.190224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.238522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:45:00.243987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.289609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ba33-9822-4884-9c48-c0fcf28b7651 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.323349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.323938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.324217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.324489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.325231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:00.325536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.328081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.339697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 8/16] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:00.340668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15711a-5ad4-4156-947e-c376156e16b0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.345770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.362662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.372140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.377681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.378544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.378830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.379106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.390028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.391320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:45:00.412306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:00.413095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:00.413869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:45:00.413869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:45:00.413869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:45:00.413869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:00.413869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:00.419299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.449184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd1c2-5dd6-4c94-9c5b-4f088733fed1 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.484127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.485005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.485286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.485559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.487149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.488613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.490317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:00.495646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.522500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476f09-664f-401c-8b00-57496cf20260 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.556914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.557809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.558093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.558404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.559129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:00.559441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.560847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.578936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:00.590202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.599338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e3860-d2d9-4aa6-89dc-1456c7652078 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.635685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.636512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.636800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.637077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.638401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.640455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982cca2-8e9b-4703-a70f-c1dc32f6b879 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.642224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:00.648474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:00.685086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:00.756952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ae40-6096-4f40-ab42-eafa28e7439b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:00.792171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:00.792827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:00.793112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:00.793390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:00.794262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.domain.id=default, user.id=99dd72bb591043628f61cab7bc928f4c) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:00.794583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:00.796129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b239-e808-460a-a7b4-bf62f9b04b2f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:00.803169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Tue May 24 12:45:00 2022] GET /identity/v3/role_assignments?user.id=99dd72bb591043628f61cab7bc928f4c&scope.domain.id=default&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:03.098253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd095e-3e60-4cb9-915c-b2f65c849bbd None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.099260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd095e-3e60-4cb9-915c-b2f65c849bbd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.099761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd095e-3e60-4cb9-915c-b2f65c849bbd None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.101358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:03.106757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243439-ce41-4d56-ac89-38ab454a5362 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.107553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243439-ce41-4d56-ac89-38ab454a5362 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.109025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243439-ce41-4d56-ac89-38ab454a5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.135382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f7243439-ce41-4d56-ac89-38ab454a5362 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:03.136939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f7243439-ce41-4d56-ac89-38ab454a5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:03.216469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:03.251478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd095e-3e60-4cb9-915c-b2f65c849bbd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:03.417618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd095e-3e60-4cb9-915c-b2f65c849bbd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:03.473325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:03.474234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.474519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.474851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.501515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:03.503014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:03.535912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1f4d-463b-4e00-99be-190b99c12e3e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.536561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1f4d-463b-4e00-99be-190b99c12e3e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.537048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1f4d-463b-4e00-99be-190b99c12e3e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.538758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:03.548559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.549238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.549718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.591192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:03.592880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:03.637353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-d66f2bdb-cb22-446c-8237-5a33b3ac110f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:45:03.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:03.668541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:03.669323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:45:03.669323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:45:03.669323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:45:03.669323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:03.669323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 12/25] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:03.670099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626956-76e6-4498-bd86-4e14a5ff08f1 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.670986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626956-76e6-4498-bd86-4e14a5ff08f1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.671268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626956-76e6-4498-bd86-4e14a5ff08f1 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.673491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 13/26] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:03.682137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:03.682137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:03.682137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:03.701387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:03.703453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:03.714798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:03.737840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 24 12:45:03.738994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:03.792061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 14/28] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:03.793265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:03.928185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334e30-5946-461b-b390-7270f39105f0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:03.982325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654ef2-59c7-4db2-9fc5-cdfd4d3fddc7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:04.005380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:04.006051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.006399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.006684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.007420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:04.007727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:04.009400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:04.037381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:04.038251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:04.040309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:04.040989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.041268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.041541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.042307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:04.043691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:04.070797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:04.211775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 15/30] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 24 12:45:03 2022] POST /identity/v3/roles => generated 225 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:04.213476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:04.221121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42109e8c-8050-4319-b8f6-63c04efcc9de None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:04.222477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:04.297716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:04.298843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.299333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.299877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.300890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:04.303981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa49898-736f-454a-9ab1-35890683ef84 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:04.442503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446307-3bc5-4cc9-8d98-f1837ce33ce9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:04.490807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:04.491704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.492150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.492580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.493434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:04.494347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 16/31] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 24 12:45:04 2022] POST /identity/v3/roles => generated 219 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:04.495363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:04.496154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304229f8-4238-4fcc-8c13-37eb1b38b3e0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.496549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304229f8-4238-4fcc-8c13-37eb1b38b3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.496935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304229f8-4238-4fcc-8c13-37eb1b38b3e0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.498514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 17/32] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:04.504568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3f50-2de4-4cac-a257-32f01fcbb794 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.505235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3f50-2de4-4cac-a257-32f01fcbb794 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.505724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3f50-2de4-4cac-a257-32f01fcbb794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.527105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-686b3f50-2de4-4cac-a257-32f01fcbb794 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:04.529162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-686b3f50-2de4-4cac-a257-32f01fcbb794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:04.535219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 16/33] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:45:04 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:04.632666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:04.664361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:04.682816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60ebf-f605-46fb-8a71-a0186217b727 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.683447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60ebf-f605-46fb-8a71-a0186217b727 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.683927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60ebf-f605-46fb-8a71-a0186217b727 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.685731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 19/35] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:04.691780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.692393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.692923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.719207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:04.720772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:04.723458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:04.745519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:04.804226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c556-3038-4b14-a4f7-2b4edb0aae8a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:04.814494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:04.840480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:04.849609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:04.850731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:04.851169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:04.851627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:04.864801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:04.873013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:04.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:04.875639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:04.877539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 17/37] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:04.884666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:04.974648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fbd4-2dfd-4a73-9576-bcd853275fd8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.005640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632dfa-46c7-43da-a748-076047486a76 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.010045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.010761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.011053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.011335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.012084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.013624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b657b-d365-43b7-bad4-7c4f9579a732 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.021515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:05.025919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:05.038152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 21/38] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 24 12:45:04 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:45:05.047425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.048134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.048426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.048709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.049857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:05.050202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.051052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a856f-4371-42a7-ac73-73efa7939a60 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.051355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a856f-4371-42a7-ac73-73efa7939a60 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.051638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a856f-4371-42a7-ac73-73efa7939a60 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.051730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.053341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 22/39] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:05.060109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.060402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.060679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.063258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 18/40] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:05.070285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:05.079719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:05.080941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:05.159980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:05.183364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:05.188337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff4b58-dfde-4c2e-bc4b-c56742dc9c6b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.228050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.228935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.229324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.229608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.231006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.233562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.235824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 19/42] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:05 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:05.242340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:05.304873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:05.310407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fd52a-0f4e-4df0-8bb4-93cd56855175 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.338552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:05.347822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.348617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.348906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.349188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.350389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.351863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.353505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 24/43] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:05.358998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:05.364999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5645f-601f-4717-a86a-7612f766e905 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.399537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.400330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.400619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.400902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.402081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.403568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.406076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 20/44] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:05.411614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:05.464972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eacf2-e9c6-460a-972a-dd2b678a30c2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.500409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.501066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.501354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.501632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.502383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.503845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2436a-ceb0-4ebc-85ea-1d29c67ddf6a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.512323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cd524-3c00-4f47-a110-e2969cd81897 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:05.526613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:05.531314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 25/45] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:45:05 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:45:05.548780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:05.549694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:05.549982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:05.550303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] PATH_INFO: `/v3/domains/default/users/99dd72bb591043628f61cab7bc928f4c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:05.552452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99dd72bb591043628f61cab7bc928f4c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:05.553959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35eccb-b774-4709-92ea-670c058a6064 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:05.570080 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 21/46] 10.222.0.36 () {58 vars in 1361 bytes} [Tue May 24 12:45:05 2022] PUT /identity/v3/domains/default/users/99dd72bb591043628f61cab7bc928f4c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:45:07.770905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2527b-076f-49a0-872e-b4234a034b4b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:07.771406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2527b-076f-49a0-872e-b4234a034b4b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:07.771406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2527b-076f-49a0-872e-b4234a034b4b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:07.772806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 26/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:07.775106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fac5-2b89-4308-aac1-16fc23dfcfe6 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:07.775470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fac5-2b89-4308-aac1-16fc23dfcfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:07.775740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fac5-2b89-4308-aac1-16fc23dfcfe6 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:07.777156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 22/48] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:07.777890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:07.778218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:07.778506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:07.782692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:07.783058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:07.783337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:07.796468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:07.797670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:07.801446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:07.802962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:07.841512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:07.866213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 27/49] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:07.870288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 23/50] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:07.890936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:07.896311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:07.989740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86c7c-0c19-487b-bba2-e24c1864766f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:07.993714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4de91-81dd-4d61-aea3-adf258e0f717 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:07.996418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:08.025436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.026191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.026488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.026765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.027949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.029417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.031178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 28/51] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:08.031403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.032207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.032493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.032767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.036649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:08.043259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:08.051485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:08.052480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:08.053424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 24/52] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:08.058294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:08.083586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:08.141922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e3a4-b43d-4e74-9c73-c1a8eabe9f38 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:08.161066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c5d4-9749-4266-aa82-0fc467af9d0f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:08.180842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.181508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.181798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.182077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.182835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.184307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.205268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.205936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.206264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.206548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.207292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:08.207599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.209068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.210334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 29/53] 10.222.0.36 () {60 vars in 1140 bytes} [Tue May 24 12:45:08 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:08.218122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 25/54] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:08.224087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:08.327650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:08.331638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425d78-f191-41f2-a448-14d5a52a59cb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:08.368400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.369296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.369583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.369863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.371166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.372681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.375554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 30/55] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:08 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:08.381157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:08.412710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:08.489967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7fdcf-31b9-4176-873e-71c7a058ce70 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:08.522289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.523083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.523367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.523642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.524837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.526313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eba9d4-f741-4c78-8316-9e53c11481dd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.527967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 26/56] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:08.534320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:08.632666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e79a1-0381-4848-bafe-0c8bfa97d360 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:08.665517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:08.666202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:08.666493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:08.666775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:08.667610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.domain.id=default, user.id=99dd72bb591043628f61cab7bc928f4c) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:08.667927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:08.669383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222757d-32c3-442a-93d9-0c28d218f282 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:08.676106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 31/57] 10.222.0.36 () {56 vars in 1322 bytes} [Tue May 24 12:45:08 2022] GET /identity/v3/role_assignments?user.id=99dd72bb591043628f61cab7bc928f4c&scope.domain.id=default&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:10.426646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b72b-7eff-40d1-b7f6-26d0ac5f1664 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:10.427098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b72b-7eff-40d1-b7f6-26d0ac5f1664 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:10.427209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b72b-7eff-40d1-b7f6-26d0ac5f1664 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:10.428614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 27/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:10.433829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:10.434222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:10.434434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:10.452190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:10.453391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:10.475986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:10.519589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:10.543311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105b72b-7eff-40d1-b7f6-26d0ac5f1664 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:10.638072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:10.646262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105b72b-7eff-40d1-b7f6-26d0ac5f1664 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:10.679043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:10.679766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:10.680049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:10.680326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:10.681475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:10.682948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f2495-e577-479f-af01-2cc9a68a8485 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:10.684571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 28/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:10.691005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:10.788544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00b71-0aba-4544-8c57-6e2984cc3485 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:10.821060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637582df-f268-4559-9030-68432d8bc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:10.821720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637582df-f268-4559-9030-68432d8bc7be None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:10.822006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637582df-f268-4559-9030-68432d8bc7be None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:10.822314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637582df-f268-4559-9030-68432d8bc7be None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:10.823015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637582df-f268-4559-9030-68432d8bc7be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:10.824470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637582df-f268-4559-9030-68432d8bc7be None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:10.849052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 33/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:10 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:13.972270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6396-8242-4be7-b405-40a7fb2a10f5 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:13.973137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6396-8242-4be7-b405-40a7fb2a10f5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:13.973585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6396-8242-4be7-b405-40a7fb2a10f5 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:13.975186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 29/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:13.980622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698f2e-f1e3-4445-83ea-f0af48deeb5e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:13.981013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698f2e-f1e3-4445-83ea-f0af48deeb5e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:13.981199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71698f2e-f1e3-4445-83ea-f0af48deeb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.007104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-71698f2e-f1e3-4445-83ea-f0af48deeb5e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:14.008575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-71698f2e-f1e3-4445-83ea-f0af48deeb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:14.020329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:14.100466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:14.146486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6396-8242-4be7-b405-40a7fb2a10f5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.315457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6396-8242-4be7-b405-40a7fb2a10f5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.328763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137370f-107b-453e-af58-08de01fa2d37 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.329395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137370f-107b-453e-af58-08de01fa2d37 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.329902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137370f-107b-453e-af58-08de01fa2d37 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.331591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 35/64] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:14.337049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.337602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.338083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.366266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:14.369014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:14.383043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:14.384422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.384907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.385380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.408094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:14.419499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:14.420923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:14.421835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:14.424787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 30/65] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:14.430886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.483717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:14.491316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 36/66] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:14.529199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.590273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8023f-7436-4e56-b4f3-85f331773a7f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.628583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:14.629271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.629560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.629840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.630648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:14.630960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:14.631189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:14.632450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cdd0a-c19b-45b5-bbec-f62fbdaae110 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:14.643444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 31/67] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:14.644416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514557-3880-4eab-8e79-b77059247d3c None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.644714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514557-3880-4eab-8e79-b77059247d3c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.644998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514557-3880-4eab-8e79-b77059247d3c None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.651269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 32/68] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:14.652217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514557-3880-4eab-8e79-b77059247d3c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.662018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4fb30-6f55-4b57-8b59-9da92d828c92 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.706012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:14.707190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.707673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.708167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.720656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-59f84c46-b3b5-4883-9bdb-a89c03e7f77f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:14.730134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:14.730985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:14.731720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:14.734138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 37/69] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:14.735692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c96-0598-4de3-be1d-179a342f984e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.736213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c96-0598-4de3-be1d-179a342f984e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.736717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c976c96-0598-4de3-be1d-179a342f984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.746842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:14.756727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5c976c96-0598-4de3-be1d-179a342f984e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:14.758483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5c976c96-0598-4de3-be1d-179a342f984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:14.767714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514557-3880-4eab-8e79-b77059247d3c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.803417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:14.804431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.804608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.804894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.823834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:14.825420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:14.831828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 33/70] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:14.831828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.842647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 38/71] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:14.852056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b009c9-69fa-40e7-8442-65b88b1185f4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.853030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b009c9-69fa-40e7-8442-65b88b1185f4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.853493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b009c9-69fa-40e7-8442-65b88b1185f4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.855156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 39/72] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:14.856625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b009c9-69fa-40e7-8442-65b88b1185f4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:14.942439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:14.942925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873703de-c979-4134-8729-c8cc47cc6405 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.980057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:14.981100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.981100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.981285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:14.982038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:14.982381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:14.984343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befacb63-8622-418d-9e1a-c4e6e99c4cf2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:14.985394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b009c9-69fa-40e7-8442-65b88b1185f4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:14.993462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 34/73] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:14.994719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:14.995015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:14.995299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.002858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.015105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:15.016322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:15.028088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.028837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.029127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.029440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.082983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 35/74] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:15.083830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.110198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.111658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.175139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.186426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de3a4-ca10-433b-b54f-74573527c9fb None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.211328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 40/75] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:15.212165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.224138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.224941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.225235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.225515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.227391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.237595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-43816e3d-16eb-4172-9cfa-7cdc66984846 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:15.245318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:15.246241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:15.246989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 36/76] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:15.248069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba78d-27f0-48ae-ab07-38c5fe25053c None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.248382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba78d-27f0-48ae-ab07-38c5fe25053c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.248668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba78d-27f0-48ae-ab07-38c5fe25053c None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.250023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 37/77] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:15.250756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ba78d-27f0-48ae-ab07-38c5fe25053c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.316544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77553843-ad34-47fb-8271-4bab47a09e67 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.350300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.351171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.351462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.351742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.352914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.353034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ba78d-27f0-48ae-ab07-38c5fe25053c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.354494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.356173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 41/78] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:15.356939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.391645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.392288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.393217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.393534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.393814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.405053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:15.413038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:15.414030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:15.414979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 38/79] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:15.415761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.461235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607337cf-936c-4170-b7eb-85983540ef1a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.470657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.496446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.497482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.497779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.498042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.499779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.501298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44315384-37ff-4ab8-b614-243ae701ed03 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.503079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 42/80] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:15.504223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.504508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.504786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.516511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b18c-5921-4256-86ea-34cd4658e8a9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.521387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:15.522620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:15.550678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.551348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.551629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.551905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.552648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:15.552957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.554364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.563168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 39/81] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:15.564221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.590417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 43/82] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:15.591262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.621068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.682242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ed91-89e5-4cf2-9629-b63a1581b3f2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.690887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc960a-de9e-4823-847e-30221b06028f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.697573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.716294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.717567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.717855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.718161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.725678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.726390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.726682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.726963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.727745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:15.728058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.729473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.740901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 44/83] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:15.741704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.786775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.788244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.837384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:15.844970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eea6b-5a51-42e4-80f6-2798460b38a3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:15.878379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:15.879247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:15.879544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:15.879827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:15.880670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:15.880991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:15.882479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:15.891768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 40/84] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:15.891768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.892007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 45/85] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:15.892007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:15.907508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.013141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9b33-70b1-4a95-bb8a-ee6f7247166e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.015342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2cc9-977e-446d-964b-504c6ea5a2fb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.053291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.054106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.054408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.054532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.054708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.055308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.055599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.055880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.055967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.057138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.057404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.058645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.064469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 46/86] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:16.064469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.064676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 41/87] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:15 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:16.064676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.095248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.161765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.173637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbfe34-32ab-4915-bddc-238ec094a72a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.179660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f719-8fd8-4edc-8a0e-0be6a6c30e89 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.215446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.215719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.216230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.216561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.217601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.218517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.218633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.218813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.219093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.220193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.220351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.221794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.221953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 42/88] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:16.222732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.229029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 47/89] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:16.229696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.330422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801241de-fa77-49a9-8b58-35127f2fc757 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.336362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.346710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a90c4-0e13-4018-bcb2-532b38917969 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.370244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.370934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.371211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.371491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.372201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.376481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.390519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.391306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.391550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.391947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.401666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 43/90] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:16 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:16.402484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.418690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.488555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.490149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.536515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791238-9042-4dc2-b36a-58e5af9c00ea None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.583557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.584594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.585089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.585628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.586892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=99dd72bb591043628f61cab7bc928f4c) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:16.587543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.589196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.598645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 44/91] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/role_assignments?user.id=99dd72bb591043628f61cab7bc928f4c&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:16.599741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.612181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 48/92] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:16.617871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.621716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.700027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.744528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb63a8-91a1-478a-95b4-470645e8d8cd None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.771146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27254c-6be0-421f-9f64-83b3b9003378 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:16.795667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.796913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.797394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.797903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.820368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:16.821638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:16.822178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:16.822649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] PATH_INFO: `/v3/projects/6160983a05bc4e498819b4ea7dd0fb46` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:16.824204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] RBAC: Authorizing `identity:get_project(project_id=6160983a05bc4e498819b4ea7dd0fb46)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.825952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.828250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 49/93] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/projects/6160983a05bc4e498819b4ea7dd0fb46 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:16.835127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:16.906800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:16.908276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:16.940125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.991521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:16.992161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac694e6-361f-4cff-9c94-2f94ffa2ba04 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:17.035551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:17.036298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:17.036491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:17.036768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:17.037611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=6160983a05bc4e498819b4ea7dd0fb46, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:17.037923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:17.039958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:17.043788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 45/94] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:17.047513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 50/95] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:16 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=6160983a05bc4e498819b4ea7dd0fb46&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:17.057356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:17.180141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63705cf-3807-4e1e-987c-daae6d9207a6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:17.221606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:17.222509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:17.222791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:17.223064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:17.224281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:17.225776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5e03d-17d7-4db7-87d1-189fb6e82efe None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:17.227776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 46/96] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:17 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:17.235125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:17.424029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5e2d-8113-4837-9a10-497f02f3830a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:17.461469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:17.472926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:17.473584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:17.473873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:17.474180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:17.475035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:17.475354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:17.476809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926431a-2367-41c4-a044-a913753ee2c5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:17.486667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 51/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:17 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1416455d2fac4316b955fc157b047ccd => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:18.700368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1773-e63f-4fb1-b138-12b4eb0a7ec9 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:18.701926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1773-e63f-4fb1-b138-12b4eb0a7ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:18.702606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1773-e63f-4fb1-b138-12b4eb0a7ec9 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:18.704332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 47/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:18.710382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:18.710889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:18.710968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:18.736091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:18.737285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:18.807372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 52/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:18.830410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1773-e63f-4fb1-b138-12b4eb0a7ec9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:18.883018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:18.956887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1773-e63f-4fb1-b138-12b4eb0a7ec9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:18.993275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:18.994079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:18.994395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:18.994674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.006020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:19.014335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:19.015187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:19.015913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 48/100] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:19.022451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:19.136162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475e9f7-c0aa-4402-a6b1-a5df803e0b11 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:19.158677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:19.173498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:19.174375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:19.174761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:19.175139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.176004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:19.176411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:19.178453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:19.188506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 53/101] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:19.194213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:19.463870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:19.468142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35bd89-344a-43c7-a8eb-bc1a54ca6481 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:19.552177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:19.553069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:19.553357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:19.553634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.558872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:19.560346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:19.564899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 49/102] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:19 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:19.571231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:19.731560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071a11-845b-4dd0-99fc-aab1aad711a0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:19.780697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:19.781596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:19.781889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:19.782202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.783675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:19.785197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6b4d4-9e29-4a59-ad85-5d81540d2f05 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:19.787076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 54/103] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:19 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:19.792950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:19.855929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f273-e92d-4750-9677-980349cbd932 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:19.856238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f273-e92d-4750-9677-980349cbd932 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:19.856508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4f273-e92d-4750-9677-980349cbd932 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.858479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 55/104] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:19.863401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ca-96b1-4e7e-8110-bc0dde02c05b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:19.863692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ca-96b1-4e7e-8110-bc0dde02c05b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:19.863971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552ca-96b1-4e7e-8110-bc0dde02c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:19.891641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-14d552ca-96b1-4e7e-8110-bc0dde02c05b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:19.892847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-14d552ca-96b1-4e7e-8110-bc0dde02c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:19.967822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698deed-2aae-4a80-bdc2-88f06f8b4a36 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.004693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.018843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.019247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 56/105] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:20.020185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.020185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.020382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/users/5687ea345df74500817cf00fff7beade/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.021273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5da3e-1e5f-46b7-9d79-adc57af9ad19 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.021901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5da3e-1e5f-46b7-9d79-adc57af9ad19 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.022468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5da3e-1e5f-46b7-9d79-adc57af9ad19 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.024308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 57/106] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:20.025431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, user_id=5687ea345df74500817cf00fff7beade, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:20.027004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:20.038006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.038374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.038721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.060387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:20.062161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:20.063753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 50/107] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:19 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/users/5687ea345df74500817cf00fff7beade/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:20.064876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.154612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.210667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 58/108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:20.240228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.265921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9931bb-1f13-49ab-9e33-caa176ac8ae3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.348307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.349125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.349409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.349684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.351204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13b4d3-f4a5-4fc5-867c-c33cb767cbc5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.354850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:20.356335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:20.359039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 51/109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:20.363851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.364240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.398254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.399068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.399355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.399682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.417494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:20.426176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:20.427095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:20.428275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 59/110] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:20.435100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.547137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.552298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd5ca-8397-4574-8f18-987fee8fccae None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.594802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d595d34-5011-4b30-930a-4c5f432b53ab None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.596290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.597298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.597848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.598231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.599110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:20.600909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5a8c-06ec-4a96-911a-67a639f31e9b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:20.630671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 52/111] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:45:20 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:45:20.632150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926c50-a3b2-4903-8c19-b18b8ec14d28 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.632567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926c50-a3b2-4903-8c19-b18b8ec14d28 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.632856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92926c50-a3b2-4903-8c19-b18b8ec14d28 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.634696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 53/112] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:20.641229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.641580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.641797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.647439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.648489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.649062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.649538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.650666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:20.651277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:20.653152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:20.659826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:20.661165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:20.672216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 60/113] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:20.679302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.737051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.743361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:20.804785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.862638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e396-87a3-4487-80ba-eba3241ddec5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.920301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:20.939341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f4f3-4a74-4ce7-95e9-741d971b252e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:20.950393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.951843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.952132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.952419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.953781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:20.955315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51bc99-e347-4f84-b618-2597b6f2a546 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:20.957393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 61/115] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:20.958560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c695a-b509-4814-99b3-ece120ad9f18 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.958892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c695a-b509-4814-99b3-ece120ad9f18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.959125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c695a-b509-4814-99b3-ece120ad9f18 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.960527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 62/116] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:20.965309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c695a-b509-4814-99b3-ece120ad9f18 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:20.981661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:20.983480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:20.984021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:20.984513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:20.995994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7a67a317-1a32-4a8b-8e50-48dab7832ac8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:21.005021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:21.005874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:21.006653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:21.009549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 55/117] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:21.011117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.011612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.012090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.031455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:21.033205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:21.077502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:21.083172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c695a-b509-4814-99b3-ece120ad9f18 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.114357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 56/118] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:21.115640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.127214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.128111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.128878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.129158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.131267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:21.133057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:21.136542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 63/119] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:20 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:21.143542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.196549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:21.236434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc99ae-d91f-41e2-9186-e67019c27232 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.271485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582e6-e342-4605-94e5-61f23377b48e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.291094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.291791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.292082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.292362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.293186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:21.293504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:21.294985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:21.309876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.311671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.312156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.312627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/users/99dd72bb591043628f61cab7bc928f4c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.313340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 57/120] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:21.314236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.315480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, user_id=99dd72bb591043628f61cab7bc928f4c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:21.317145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:21.346048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 64/121] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:21 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/users/99dd72bb591043628f61cab7bc928f4c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:21.347333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.420241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:21.434768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6100f-5872-493f-bd5f-65b40edbd71a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.470710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:21.477920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.479160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.479655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.480158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.510605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:21.520022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:21.520968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:21.521703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:21.530782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 58/122] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:21.552087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.580031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a2b2f-1de0-4551-a197-bc06017266e3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.648474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.649281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.649564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.649943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] PATH_INFO: `/v3/users/80db8d1de67c48f9901b04b61f48d3f1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.668724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] RBAC: Authorizing `identity:get_user(user_id=80db8d1de67c48f9901b04b61f48d3f1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:21.670924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258daab6-efb4-4158-8da3-e26cfc1b9f0c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:21.672883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 65/123] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:21 2022] GET /identity/v3/users/80db8d1de67c48f9901b04b61f48d3f1 => generated 289 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:21.673978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e14ad-9e6b-48d6-aa40-94e38e3a98d3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.674474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e14ad-9e6b-48d6-aa40-94e38e3a98d3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.674747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e14ad-9e6b-48d6-aa40-94e38e3a98d3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.676043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 66/124] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:21.683031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e14ad-9e6b-48d6-aa40-94e38e3a98d3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:21.764519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f743e-8a1a-4e7b-ab88-b351dce2a116 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.828716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:21.837689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.838407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.838728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.838977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.839740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:21.840053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:21.841576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a17330-0377-4e37-a668-c0d73b2c3efa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:21.852241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 59/125] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:21.853542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.853832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.858701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.874804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e14ad-9e6b-48d6-aa40-94e38e3a98d3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:21.876567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:21.877933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:21.920635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:21.921256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:21.921545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:21.921828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:21.968103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.016582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.017009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 60/126] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:22.018047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.018459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.109219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.137602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 67/127] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:22.138666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.197162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078c5ed-93fe-4456-a8bd-9d558aa3d061 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.280752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.281908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.282373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.282808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.286896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.288596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.290484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 61/128] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:22.291422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.306334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927d78-6a6f-4682-b4c2-8a324933b07e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.346508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.347328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.347613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.347892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.371774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:22.381182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:22.382196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:22.382981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 68/129] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:22.383911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.407717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.471260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.496985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7147789-3367-49d6-a23a-923eb55e949e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.537525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ab3a0-9b16-4d05-add3-6ba800ca5a56 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.558827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.559722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.560015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.560299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.561773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.563265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.565027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 62/130] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:22.565805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.578669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.579546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.579837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.580118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] PATH_INFO: `/v3/projects/6160983a05bc4e498819b4ea7dd0fb46` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.581340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] RBAC: Authorizing `identity:get_project(project_id=6160983a05bc4e498819b4ea7dd0fb46)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.582874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.584946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 69/131] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/projects/6160983a05bc4e498819b4ea7dd0fb46 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:22.585841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.694638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887f417-d3fe-4850-9833-0888a971ca11 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.710770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.731558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.732152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.732664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.732972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.733802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=80db8d1de67c48f9901b04b61f48d3f1) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:22.734142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.735622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.741787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 70/132] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/role_assignments?user.id=80db8d1de67c48f9901b04b61f48d3f1&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:22.747232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.777053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b3e0d-fb5c-4e70-9e19-20197092d72e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:22.822141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:22.856342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:22.858226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:22.858729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:22.859200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:22.860172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:22.860699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:22.862438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:22.885095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 63/133] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:22.897629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:22.969299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8d5b-7e5a-48b9-b1f3-5fcf6e32051d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.043978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.044961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.045256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.045541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] PATH_INFO: `/v3/projects/6160983a05bc4e498819b4ea7dd0fb46/users/5687ea345df74500817cf00fff7beade/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.051880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] RBAC: Authorizing `identity:create_grant(project_id=6160983a05bc4e498819b4ea7dd0fb46, user_id=5687ea345df74500817cf00fff7beade, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:23.053383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:23.084381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 71/134] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:22 2022] PUT /identity/v3/projects/6160983a05bc4e498819b4ea7dd0fb46/users/5687ea345df74500817cf00fff7beade/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:23.104524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b75e2-7cb0-4dbe-ac57-6d591dfc59c1 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.158054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.159102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.159423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.159702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.161006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:23.162547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da870-3d68-4804-9c30-5e664a88baea None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:23.164282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 64/135] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:22 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:23.170312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:23.203683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617ef-0f21-4205-9924-60e1c6b02d26 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.204015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617ef-0f21-4205-9924-60e1c6b02d26 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.204255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617ef-0f21-4205-9924-60e1c6b02d26 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.205817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 65/136] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:23.211269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3519-fdab-4984-b79d-356626321c41 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.211562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3519-fdab-4984-b79d-356626321c41 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.211845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a3519-fdab-4984-b79d-356626321c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.236710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-093a3519-fdab-4984-b79d-356626321c41 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:23.237953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-093a3519-fdab-4984-b79d-356626321c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:23.254520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:23.342805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:23.392922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a8e0-1ab4-4f38-8d50-dc071dcbe97c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.398321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 66/137] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:23.443753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.444656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.444951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.445239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.446771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:23.448371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:23.450555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 72/138] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:23 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:23.456050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3519-fdab-4984-b79d-356626321c41 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:23.501445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:23.681182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d218905-2eb2-4ae4-bfa4-8f588137b7c9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.684257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a3519-fdab-4984-b79d-356626321c41 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.690526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:23.721546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.722621 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.722908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.723190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.734939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8a0ef92d-fdd5-4fcc-935b-6b5c452ba06c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:23.744721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:23.745563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:23.746334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 73/139] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:23.747709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dd4e-5e44-4a12-abfe-103465f9458f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.747709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dd4e-5e44-4a12-abfe-103465f9458f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.748607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4dd4e-5e44-4a12-abfe-103465f9458f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.750193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 74/140] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:23.754947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4dd4e-5e44-4a12-abfe-103465f9458f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:23.793293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.794445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.794948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.795236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/users/5687ea345df74500817cf00fff7beade/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.797514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, user_id=5687ea345df74500817cf00fff7beade, role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:23.798998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e961c2-5286-45a5-9f50-37fd112724f9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:23.833626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 67/141] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:23 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/users/5687ea345df74500817cf00fff7beade/roles/1416455d2fac4316b955fc157b047ccd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:23.834967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.835253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.835616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.855665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:23.856871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:23.876161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4dd4e-5e44-4a12-abfe-103465f9458f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:23.892496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:23.918236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:23.918980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:23.919311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:23.919590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:23.920996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:23.921308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:23.922815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:23.933222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 75/142] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:23.938844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:23.961769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 68/143] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:23.974713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:24.034038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.062931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30a2be-8d7d-44ad-8236-fc74752ae86d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.100065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.101014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.101293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.101562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.103715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:24.105178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:24.106895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 76/144] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:23 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:24.113472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.231286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43ac6-3082-4656-a656-3b83065510d6 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.274322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.275393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.275820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.276246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.277693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:24.280019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:24.281877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 69/145] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:24.287270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.297406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:24.306025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338aca-7931-4eed-ae29-bc26f9af1e19 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.330492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:24.394839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.395895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.396388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.396871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.410703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2af8f-1837-4da2-a27a-638bf645419c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.477087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.477773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.478547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.478822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.479554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:24.480993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6591af-ef9b-4fa1-b7eb-a274587879a0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:24.511039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:24.511954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 70/146] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:24 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:45:24.513446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5744-87c9-4b8a-9418-6860ccfec198 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.513866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5744-87c9-4b8a-9418-6860ccfec198 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.514174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5744-87c9-4b8a-9418-6860ccfec198 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.515275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:24.515692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 71/147] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:24.524926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.525260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.525492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.563074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:24.565487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:24.692946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 72/148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:24.719722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:24.730887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 77/149] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:24.734779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.743528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.786005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:24.885077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b94148-1584-47b8-a180-01302a9802d1 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.919225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e0b-d287-41a1-a028-e2cc75d27280 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:24.935494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.936476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.936768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.937044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.942854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:24.944332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:24.946169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 73/150] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:24 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:24.952206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:24.961417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:24.962238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:24.962518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:24.962787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:24.985433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:24.993093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:24.993911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:24.994691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:24.995413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 78/151] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:25.015305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:25.124650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:25.150409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:25.171811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ddf8-ee15-4b41-b9d4-88287e1e3bb0 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:25.205470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620dfa-53d5-4119-a344-a8fb3cc1e5e0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:25.245763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:25.245997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:25.246567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:25.246848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:25.247124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:25.247271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:25.247686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:25.248398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:25.248779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:25.248883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:25.249857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:25.250330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:25.250433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:25.252096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:25.260335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 79/152] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:25.263596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 74/153] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:24 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:25.266583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:25.388378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0750-823a-4132-aabb-84b70a6da0ed None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:25.411142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:25.429957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:25.430936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:25.431220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:25.431496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] PATH_INFO: `/v3/users/99dd72bb591043628f61cab7bc928f4c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:25.432837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] RBAC: Authorizing `identity:get_user(user_id=99dd72bb591043628f61cab7bc928f4c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:25.434381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:25.436447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 80/154] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:25 2022] GET /identity/v3/users/99dd72bb591043628f61cab7bc928f4c => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:25.441896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:25.559083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6190-0c94-4d1c-9bb3-36f93065be93 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:25.602830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:25.603501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:25.603790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:25.604067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:25.639129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:25.693933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:25.695537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:25.818987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 75/155] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:25.824677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:25.967103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ea43-c48f-4372-9953-719e5b57488b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:26.008998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:26.010644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.011134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.011596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.013054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:26.014950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e07281-a88c-40de-a42a-586700c5e973 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:26.016924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 81/156] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:25 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:26.022960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.106505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:26.157154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7d1c-c037-4c59-a46e-4a2f2ceef601 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:26.202377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:26.203054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.203343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.203631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.204472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=99dd72bb591043628f61cab7bc928f4c) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:26.204788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:26.206271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65673478-383e-4880-8d73-6bda88e049d0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:26.213110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 76/157] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/role_assignments?user.id=99dd72bb591043628f61cab7bc928f4c&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:26.229294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b842cac-dc70-449d-91a6-0f66660bb32b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.229888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b842cac-dc70-449d-91a6-0f66660bb32b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.230409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b842cac-dc70-449d-91a6-0f66660bb32b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.232071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 82/158] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:26.238720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.239013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.239291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.264062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:26.265346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:26.302903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8a44-90cc-432b-b0e1-0148a7e940ad None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.303514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8a44-90cc-432b-b0e1-0148a7e940ad None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.304032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8a44-90cc-432b-b0e1-0148a7e940ad None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.305857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 83/159] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:26.311685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.312262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.312744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.335096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:26.337998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:26.368082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 77/160] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:26.423616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.459449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:26.493249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 84/161] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:26.520540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:26.590748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.595403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c35e76-72b5-45b0-93ea-ef3954368b25 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:26.649485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:26.651537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.652569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.653232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.676796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:26.691274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:26.692164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:26.692898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:26.698275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 78/162] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:26.704103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.776719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869c542-91d8-44a1-bcc5-caffdef12187 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:26.822746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:26.823865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.824438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.824886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.839473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:26.851888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ff44e-1ce7-44d4-ac2d-eb3746e70a4e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:26.852274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:26.853331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:26.854316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:26.855415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 85/163] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:26.862283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.866140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:26.895117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:26.895804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:26.896095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:26.896376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:26.897138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:26.897453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:26.900045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:26.909793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 79/164] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:26.915592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:26.962671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:27.063342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d96a1-2e86-4984-9fb8-cb3f7b12ea5d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.100454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.101067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043870f-8ec7-4c44-a3a0-826570d47251 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.102098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.102539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.103021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] PATH_INFO: `/v3/users/80db8d1de67c48f9901b04b61f48d3f1` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.104493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] RBAC: Authorizing `identity:get_user(user_id=80db8d1de67c48f9901b04b61f48d3f1)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.106094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:27.108757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 80/165] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/users/80db8d1de67c48f9901b04b61f48d3f1 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:27.119202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:27.186890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.187586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.187875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.188156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.188934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:27.189242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.189688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:27.194158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:27.208832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 86/166] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:27.213929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:27.306601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc371f9-4e61-4c09-9d50-51be51bbd528 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.403916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.405290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.405580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.405860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.407112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.408580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:27.418608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 81/167] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:27 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:27.431191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:27.456440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f05c00-8c71-4fc4-92d7-391e6b177f3e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.475050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:27.520574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.521841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.522348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.523150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.524708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.526484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:27.528373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 87/168] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:27 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:27.534842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:27.693899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936829f-213e-478a-b0b7-1a4694b79462 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.710520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:27.728152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c4a47-bcb7-4c40-a8d8-0a6e90bd67d7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:27.758254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.759880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.760439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.760877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/users/80db8d1de67c48f9901b04b61f48d3f1/roles/d22c0c73fdc5451198e8f6b9e59d652c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.763012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, user_id=80db8d1de67c48f9901b04b61f48d3f1, role_id=d22c0c73fdc5451198e8f6b9e59d652c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.765343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa81e-e1e4-42db-8d4d-957da7a29f66 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:27.787345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 82/169] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:27 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/users/80db8d1de67c48f9901b04b61f48d3f1/roles/d22c0c73fdc5451198e8f6b9e59d652c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:27.796341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cfe54-6bdb-4536-a031-219c0677aa23 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.796836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cfe54-6bdb-4536-a031-219c0677aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.797255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cfe54-6bdb-4536-a031-219c0677aa23 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.801991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 83/170] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:27.811426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:27.812350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.812771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.813182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.843482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:27.844015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:27.844435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:27.872193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:27.874481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:27.897798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:27.930373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:27.932428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:28.021978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:28.072468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.100247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 88/172] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:28.105322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.210446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:28.217888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545f34-ff30-4080-a7ca-5f01bf3e47c8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.218528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:28.259283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c69c10-090c-4e57-a254-26cb882fffcb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.261620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.262680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.263217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.263831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.275679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:28.285494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:28.286780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:28.287569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:28.290152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 85/173] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:28.296577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.312840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.313614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.313890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.314252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] PATH_INFO: `/v3/projects/6160983a05bc4e498819b4ea7dd0fb46` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.318866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] RBAC: Authorizing `identity:get_project(project_id=6160983a05bc4e498819b4ea7dd0fb46)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:28.320359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:28.322176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 89/174] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/projects/6160983a05bc4e498819b4ea7dd0fb46 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:28.328677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.412397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2abff5-e27b-4ed7-832b-8246655b7809 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.449069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaf1ef-4ac1-4281-bd01-93ed8d422ddf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.450334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.451964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.452610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.453103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.454100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:28.454663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:28.456252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:28.465656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 86/175] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:28.471827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.485903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.486607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.486891 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.487171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.488084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=6160983a05bc4e498819b4ea7dd0fb46, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:28.488316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:28.489766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:28.495911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:28.496037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 90/176] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=6160983a05bc4e498819b4ea7dd0fb46&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:28.589653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f779c91-f884-49c9-b387-419e47945181 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.638523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.639392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.639675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.639950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] PATH_INFO: `/v3/users/5687ea345df74500817cf00fff7beade` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.642896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] RBAC: Authorizing `identity:get_user(user_id=5687ea345df74500817cf00fff7beade)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:28.644696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d4f37-68b7-43d9-8bdb-83a8d9c6820c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:28.646681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 87/177] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/users/5687ea345df74500817cf00fff7beade => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:28.655438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.671626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:28.678363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d83b5-d149-43b1-a32d-3af05259e8a9 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.678967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d83b5-d149-43b1-a32d-3af05259e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.679538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d83b5-d149-43b1-a32d-3af05259e8a9 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.681539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 88/178] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:28.687265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.687823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.688320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.712943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:28.714556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:28.808098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 89/179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:28.851248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:28.869696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd927-adc6-4430-b5ec-1143a48d2462 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:28.876396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:28.923759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:28.924647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:28.924756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:28.924966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:28.972290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95201050-86a8-45b1-b11d-a51c65e3b889 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.012195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.013423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.013913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.014439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.021817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.023355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.026810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:29.032174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:29.035891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:29.036786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:29.037546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:29.040037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 90/180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:29.046648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.138193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 91/181] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:29.145489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.208145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.252278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee25f1-5cf0-42e0-bb4d-7a27feacc315 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.315893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.316676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.316972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.317250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.318011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:29.318348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.319833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3378-1b30-425f-be91-5ea4f00949e5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.329209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 91/182] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:29.330464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517212-1048-4f05-9c50-acc446889db2 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.330752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517212-1048-4f05-9c50-acc446889db2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.331029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517212-1048-4f05-9c50-acc446889db2 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.332574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 92/183] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:29.339264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48517212-1048-4f05-9c50-acc446889db2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.340508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799d03-6c8c-4286-9353-243bf7ec39ac None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.348744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.384189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.385059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.385336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.385611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.386826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.388372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3e326-7c95-4d8c-bcc3-7dc0fad7e2d3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.394161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 92/184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:29.394161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f6c9-d250-47fa-89a5-ef8ab59c6e6b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.394161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f6c9-d250-47fa-89a5-ef8ab59c6e6b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.394161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f6c9-d250-47fa-89a5-ef8ab59c6e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.410765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6ed9f6c9-d250-47fa-89a5-ef8ab59c6e6b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:29.411520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6ed9f6c9-d250-47fa-89a5-ef8ab59c6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:29.468317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48517212-1048-4f05-9c50-acc446889db2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 93/185] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e9cf-fb88-4122-a9c5-3f7baf51fca7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e9cf-fb88-4122-a9c5-3f7baf51fca7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e9cf-fb88-4122-a9c5-3f7baf51fca7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 94/186] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:29.487667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55e9cf-fb88-4122-a9c5-3f7baf51fca7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.512875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.514192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.514457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.514732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.523584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.531846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.533313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3da924-1cd2-490b-9dd2-a70cab4bcfd1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.539579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 93/187] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:29.540864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.541157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.541435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.558870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:29.560043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:29.605216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55e9cf-fb88-4122-a9c5-3f7baf51fca7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.608999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.638132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 94/188] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:29.638132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.652507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.653183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.653532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.654436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.655479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=5687ea345df74500817cf00fff7beade) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:29.655871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.657335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.664459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 95/189] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/role_assignments?user.id=5687ea345df74500817cf00fff7beade&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1416455d2fac4316b955fc157b047ccd => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:29.665781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.765013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef84079-0e93-4f4f-ab4f-4d68710d51f2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.797519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6da40-4267-4540-beb3-2d06e5634679 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:29.802548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.816859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.818349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.821293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.821585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.835683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:29.840096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:29.841056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:29.841729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:29.842352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:29.844518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:29.845395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:29.846184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 95/190] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:29.851540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:29.895292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:29.944144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:29.945579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:29.981539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02955-0958-4322-8c36-a44ff18bb7d3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.018198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.019008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.019284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.019568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.020747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.022229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.023891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:30.024656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.059130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 96/192] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:30.059130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.090362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.135396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.136468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b63e2-e66e-4a65-8a93-9df1894be50e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.170506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.171172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.171453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.171727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.172472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:30.172775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.173704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e4c10-f213-4221-af4e-f5b7ae162de5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.174151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.187884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 97/193] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:30.187884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.215059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.215764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.216166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.216995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.217862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.219376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.240614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 97/194] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:30 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:30.251664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.303564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6cd3-7a95-4606-b081-07742da82dde None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.334576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.343397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.344292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.344575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.344851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.346143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.347674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.354182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 98/195] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:30.356096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.420109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f510-5f33-40a1-9519-5ae1148a376e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.448702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.467749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.468555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.468834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.469627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.470930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.472785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.474807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 98/196] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:30.482463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.498853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595230a-0b76-4842-8ea3-df9fe32a87ac None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.545812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.546515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.546803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.547084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.547927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=1d3d49993460429d86e5625e5e7ceef6) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:30.548242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.549810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.557146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 99/197] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/role_assignments?user.id=1d3d49993460429d86e5625e5e7ceef6&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:30.606819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1234c-7466-4a96-9d1b-a9ca8ab7d24b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:30.650848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:30.651821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:30.652274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:30.652775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:30.725775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.739694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:30.741239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5336d-691c-41ed-96e3-d0d7b9a515ed None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:30.859139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 99/198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:30.864745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:30.917578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:30.989324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16298b-71ab-4cfa-9059-0076e7be0cae None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:31.040390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:31.041441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4121-d051-43ac-892c-d64df12990c1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.041733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4121-d051-43ac-892c-d64df12990c1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.042021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d4121-d051-43ac-892c-d64df12990c1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.042284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.042756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.043242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.043711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 100/199] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:31.044965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:31.046691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:31.048760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:30 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:31.054390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.054963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.055443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.057890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:31.087058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:31.090406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:31.212153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29e9a-94ce-425c-a64e-ef5197169a2a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:31.217621 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 101/201] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:31.240788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:31.266033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:31.273608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:31.274314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.274604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.274884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.275727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=1d3d49993460429d86e5625e5e7ceef6) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:31.276045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:31.277481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:31.290216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:31 2022] GET /identity/v3/role_assignments?user.id=1d3d49993460429d86e5625e5e7ceef6&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1416455d2fac4316b955fc157b047ccd => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:31.314853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:31.438795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652a20-3d51-489a-a7f2-67100f5fed0e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:31.491298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:31.492031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.492330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.492592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.509331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:31.517828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:31.518809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:31.519580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 102/203] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:31.526071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:31.649953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7c10-e6b8-4fe4-b7fe-e65a2a79d379 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:31.686195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:31.686886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.687171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.687449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.688212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:31.688524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:31.689911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:31.699002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 102/204] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:31.704474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:31.813683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:31.833429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2fd68-cdf3-4d09-a1bb-8598d85c6439 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:31.868340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:31.869222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:31.869603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:31.869893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] PATH_INFO: `/v3/users/80db8d1de67c48f9901b04b61f48d3f1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:31.871232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] RBAC: Authorizing `identity:get_user(user_id=80db8d1de67c48f9901b04b61f48d3f1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:31.873362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:31.875251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 103/205] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:31 2022] GET /identity/v3/users/80db8d1de67c48f9901b04b61f48d3f1 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:31.880838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:31.930559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:31.991487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612d36-0d4f-4cb8-ad70-895181a9bd17 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:32.034824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:32.035873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:32.036358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:32.036849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:32.112706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:32.114586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:32.170095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:32.233890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 103/206] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:32.239528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:32.419370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd8fa7-d6c1-4cf0-9a83-b6adb64d1c3a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:32.470821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:32.471702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:32.471989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:32.472260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:32.473502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:32.474998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5574-6b07-4352-ba58-c02227f79e99 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:32.476749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 104/207] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:32 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:32.485025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:32.630497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa237d-3a7e-44bb-8615-717b7f9d6231 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:32.678996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:32.679626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:32.679910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:32.680242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:32.681084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, scope.project.id=17619838f5334aa7affd20448ae3306b, user.id=80db8d1de67c48f9901b04b61f48d3f1) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:32.681398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:32.682881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7f419-2bd4-4677-942f-694c99effa5f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:32.694776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 104/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:32 2022] GET /identity/v3/role_assignments?user.id=80db8d1de67c48f9901b04b61f48d3f1&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:32.825014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebc5c-7950-4b11-b910-f608391a15c0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:32.825360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebc5c-7950-4b11-b910-f608391a15c0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:32.825587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebc5c-7950-4b11-b910-f608391a15c0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:32.827645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 105/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:32.833945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:32.834315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:32.834537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:32.849055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:32.855801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:32.857558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:32.962662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 105/210] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:32.987765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebc5c-7950-4b11-b910-f608391a15c0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.010558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.108674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebc5c-7950-4b11-b910-f608391a15c0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.155390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.156552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.157109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.157602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.172842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0f2f5b24-174f-42b0-999d-f8e7274626cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:33.181471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:33.182409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:33.183180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:33.185761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 106/211] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:33.191658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.298455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf750f-bf99-4b57-816f-e44e3de9c8af None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.333013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac03ab-9748-4695-9933-7eb02c325710 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.333971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac03ab-9748-4695-9933-7eb02c325710 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.334366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac03ab-9748-4695-9933-7eb02c325710 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.335298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.335974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.336260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.336539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.336907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 107/212] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:33.340419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:33.340419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:33.340419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:33.343074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.343585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.344082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.348539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 106/213] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:33.348973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.356582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.366618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:33.368474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:33.466912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 108/214] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:33.474544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95468-9535-4335-a7f7-27bb84ab686d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.486654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.501239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.521120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.522367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.522663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.522942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] PATH_INFO: `/v3/users/a0f4153e63614a5b9e56919f6fe83f88` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.542209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] RBAC: Authorizing `identity:get_user(user_id=a0f4153e63614a5b9e56919f6fe83f88)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:33.544168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:33.551429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 107/215] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:33 2022] GET /identity/v3/users/a0f4153e63614a5b9e56919f6fe83f88 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:33.552978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.620058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2d5a-43eb-4829-b13f-c4d44327e9b6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.625878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.674387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.676232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.677010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.677483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.679544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:33.681466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:33.681771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9008b8-b806-4b3e-84f7-6375358e4e7a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.685709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 109/216] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:33.691957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:33.719386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.720048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.720337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.720618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.776351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.796866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:33.798367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:33.803051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ed13f-4882-4d05-b375-2a3a15679da6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:33.839367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:33.840032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.840311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.840587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.841687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:33.843906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594664-1123-41a7-a389-53e6248e1c78 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:33.858624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:33.867701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 110/217] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:33 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:33.869054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc42322-69b4-4a69-b596-ef3def23a90b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.869443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc42322-69b4-4a69-b596-ef3def23a90b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.869778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc42322-69b4-4a69-b596-ef3def23a90b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.871453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 111/218] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:33.877826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:33.878137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:33.878423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:33.903055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:33.905741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:33.930679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 108/219] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:33.932296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.009749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 112/220] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:34.032678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.069882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fcef2-328e-446e-98aa-9f22e7b598ea None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.110673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.111542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.111831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.112106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.113315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:34.114858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd7281-fe61-4418-aef5-676cf8bd120b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:34.116211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:34.116684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 109/221] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:33 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:34.117855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a65a-6d65-4f5f-b387-49507b5f2b8b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.117966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a65a-6d65-4f5f-b387-49507b5f2b8b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.123301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a65a-6d65-4f5f-b387-49507b5f2b8b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.129395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 110/222] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:34.129395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a65a-6d65-4f5f-b387-49507b5f2b8b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.162021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:34.173301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a6ce-fd67-4899-a8e3-df3b05276576 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.222681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f678-d554-466d-9338-850b37357279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.223490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f678-d554-466d-9338-850b37357279 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.223775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f678-d554-466d-9338-850b37357279 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.224197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f678-d554-466d-9338-850b37357279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.239929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f678-d554-466d-9338-850b37357279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d076f678-d554-466d-9338-850b37357279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:34.250664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:34.251578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:34.252333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:34.253539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 113/223] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:34.253982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.254293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.254565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.264850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a65a-6d65-4f5f-b387-49507b5f2b8b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.274929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:34.276746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:34.302730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.303739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.304341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.304819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.305913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=a0f4153e63614a5b9e56919f6fe83f88) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:34.306441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:34.308285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:34.316369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 111/224] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/role_assignments?user.id=a0f4153e63614a5b9e56919f6fe83f88&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:34.318442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.360827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 114/225] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:34.384661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.459562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:34.476319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac114-b2ef-4a71-860b-ec5199b31046 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.484716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:34.521383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.522074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.522465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.522746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.523797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:34.523797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:34.525204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:34.535348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 112/226] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:34.546496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.632198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6497bd-64b0-4c1c-aae5-99faa687b191 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.651686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77606bf9-081c-433c-9891-cfa1f5e656b3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.686540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.687432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.687738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.687994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.689230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:34.690733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:34.692589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 113/227] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:34.697731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.718303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:34.776146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.777009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.777261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.777528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.804625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366095-309b-4bae-90aa-a7c96944839d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:34.807032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:34.826865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:34.827785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:34.828569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 115/228] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:34.833715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.840303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056743-452a-4171-9eac-63c46a41febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:34.841725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056743-452a-4171-9eac-63c46a41febc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:34.842022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056743-452a-4171-9eac-63c46a41febc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:34.842336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056743-452a-4171-9eac-63c46a41febc None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:34.843640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67056743-452a-4171-9eac-63c46a41febc None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:34.845246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67056743-452a-4171-9eac-63c46a41febc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:34.851263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 114/229] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:34.856773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056743-452a-4171-9eac-63c46a41febc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:34.992154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fcac1-46d2-4c33-9e51-0c2d37b5c40f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:35.008569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:35.024483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:35.035849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:35.036526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:35.036805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:35.037079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:35.037829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:35.038148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:35.039570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:35.057083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 116/230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:35.059122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056743-452a-4171-9eac-63c46a41febc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:35.062785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:35.100052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:35.100949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:35.101228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:35.101499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/users/1d3d49993460429d86e5625e5e7ceef6/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:35.103475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, user_id=1d3d49993460429d86e5625e5e7ceef6, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:35.105024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:35.144812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 115/231] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:34 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/users/1d3d49993460429d86e5625e5e7ceef6/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:35.221290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d73c8e-584c-486d-99b5-2c86aac98604 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:35.260291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:35.261156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:35.261495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:35.261780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:35.264098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:35.265594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:35.267819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 117/232] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:35 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:35.273452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:35.436247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c156f75-5566-4854-a1e1-b541e4a129cb None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:35.486338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:35.487204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:35.487486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:35.487756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:35.489339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:35.490899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980ad7-0989-40ab-a718-0f375b19215c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:35.493886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 116/233] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:35 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:35.499216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:35.555903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:35.636228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e912933-24df-4fb7-80c7-6cc35b1546e0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:35.692458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:35.693410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:35.693695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:35.693971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/users/1d3d49993460429d86e5625e5e7ceef6/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:35.696527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, user_id=1d3d49993460429d86e5625e5e7ceef6, role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:35.698146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436320b-03df-4e4a-b559-2c893e4f4ac8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:35.730411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 118/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:35 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/users/1d3d49993460429d86e5625e5e7ceef6/roles/1416455d2fac4316b955fc157b047ccd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:36.579648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c56e-9345-48e0-b65e-6533367473fa None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:36.580148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c56e-9345-48e0-b65e-6533367473fa None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:36.580221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c56e-9345-48e0-b65e-6533367473fa None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:36.581934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 117/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:36.586930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:36.587341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:36.587485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:36.615110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:36.616316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:36.705045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 119/236] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:36.753578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5c56e-9345-48e0-b65e-6533367473fa None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:36.776834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:36.886885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5c56e-9345-48e0-b65e-6533367473fa None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:36.923361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:36.924565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:36.925049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:36.925528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:36.936700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-8786d746-016f-4d72-b7f1-a0d2235f6bb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:36.944860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:36.945728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:36.946544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:36.949186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 118/237] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:36.955157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:36.959205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7613db-50a6-4984-9a54-953616c7bbb1 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:36.959715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7613db-50a6-4984-9a54-953616c7bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:36.960190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7613db-50a6-4984-9a54-953616c7bbb1 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:36.961791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 119/238] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:36.967459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46921-6be6-4202-81ee-59ae90a1420f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:36.967975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46921-6be6-4202-81ee-59ae90a1420f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:36.968453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46921-6be6-4202-81ee-59ae90a1420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:36.992897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-caa46921-6be6-4202-81ee-59ae90a1420f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:36.994551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-caa46921-6be6-4202-81ee-59ae90a1420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:36.999793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.067525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 24 12:45:37.069277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b675-1c30-44a4-8674-c95548d5019b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.069768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b675-1c30-44a4-8674-c95548d5019b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.070293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b675-1c30-44a4-8674-c95548d5019b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.072060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 121/240] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:37.081738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7348837-08d1-42f8-8a6c-b15fa7d98edd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.083324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.083817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.084292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.095708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.106499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:37.108147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:37.120603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.121207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.121491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.121766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.123122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:37.123615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.125319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.135342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 120/241] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:37.142157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.182801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 122/242] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:37.184040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.247207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.254564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9833-2093-4141-b85b-6f74d95de22d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.300104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.301778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.302587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.303095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.305155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.307414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.311620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 121/243] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:37.312913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.314302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d041e-3ab3-4135-90d7-84b0a278c5a7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.358646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.360317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.360602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.360879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] PATH_INFO: `/v3/users/7cc740171efe4100b6155e313af0c28f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.363115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.381585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] RBAC: Authorizing `identity:get_user(user_id=7cc740171efe4100b6155e313af0c28f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.383780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.386155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 123/244] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/users/7cc740171efe4100b6155e313af0c28f => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:37.386762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.454781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8aa8-2541-4c03-8668-879adbe2a7e1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.494226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.495776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.496208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.496670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.510855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:37.521889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:37.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:37.523929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:37.526050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 122/245] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:37.526746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcc70-9098-40ba-b91c-0d4d46c73181 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.527153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.560225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.569347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.570313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.570773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.571223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.572105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.573846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.595034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 124/246] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:37 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:37.596837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.650420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6465de-8067-4a16-b63b-710ebc998f4f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.662585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.712012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d005-d779-4271-adf7-376d4b89e3d7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.713024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.713703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.713990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.714300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.760377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:37.761501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:37.762068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:37.762622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:37.764980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:37.765573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.767468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.785294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 125/247] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:37.794145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:37.845090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:37.846650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:37.874049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.962473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7737e4-6d23-440d-88c8-e3cabed68c91 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:37.975769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 123/248] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:37.981222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:37.982483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.024336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.025191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.025478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.025759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] PATH_INFO: `/v3/users/a0f4153e63614a5b9e56919f6fe83f88` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.027110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f4153e63614a5b9e56919f6fe83f88)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:38.029561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:38.031402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 126/249] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/users/a0f4153e63614a5b9e56919f6fe83f88 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:38.038055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.092617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c790-0ced-44b5-b185-16c596dd5228 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.124499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:38.135820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.137275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.137275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.137441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.140148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:38.141614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c8ff7-9fec-4ba0-9df2-3d246fab10d9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:38.143599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 124/250] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:37 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:38.146353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bcfc-7db7-42e2-a817-e4e9f413e90f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.146635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bcfc-7db7-42e2-a817-e4e9f413e90f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.146908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43bcfc-7db7-42e2-a817-e4e9f413e90f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.148430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 125/251] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:38.152914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43bcfc-7db7-42e2-a817-e4e9f413e90f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.164821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f15ea9-eb91-49d4-983b-717ae47f55d4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.206090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.207417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.207931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.208526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.210033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:38.211717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ba06-707e-4888-901e-2b953779711b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:38.215026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 127/252] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:38 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:38.216964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.217511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.222141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.241993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:38.243536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:38.278762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43bcfc-7db7-42e2-a817-e4e9f413e90f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.291630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:38.321508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 128/253] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:38.321848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.322549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.322834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.323112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.323667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.323951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=7cc740171efe4100b6155e313af0c28f) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:38.324267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:38.326287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:38.333625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 126/254] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:38 2022] GET /identity/v3/role_assignments?user.id=7cc740171efe4100b6155e313af0c28f&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:38.371853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.479014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:38.579684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f455f-d866-4d9b-91c2-95d65fd704a5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.589994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed145f-fd46-4969-930d-477e11c259ce None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.647884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.648603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:38.649409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.649691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.649965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.650352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.650827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.651317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/users/a0f4153e63614a5b9e56919f6fe83f88/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.654103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, user_id=a0f4153e63614a5b9e56919f6fe83f88, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:38.655808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9108-3f78-4abb-92aa-99eeb7f49378 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:38.675270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:38.687284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:38.688260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:38.689047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 127/255] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:38.696284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:38.697503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 129/256] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:38 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/users/a0f4153e63614a5b9e56919f6fe83f88/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:38.717996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f91b3-9acd-4320-869c-cb58a524b09d None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.718413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f91b3-9acd-4320-869c-cb58a524b09d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.718703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f91b3-9acd-4320-869c-cb58a524b09d None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.720282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 130/257] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:38.726263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:38.726556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:38.726832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:38.771350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:38.772718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:38.846176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:38.956744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 131/258] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:38.962171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e216c9-3ed5-4fea-b42c-74e2c555222c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:38.995338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:38.997851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.030302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.031454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.033044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.034274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.035843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:39.036549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:39.039233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:39.063131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 128/259] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:39.070385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.185558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff697ce-e667-41b3-9ecf-56ae29d8ff28 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:39.245548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ce2d0-7465-4440-914c-bcb852618975 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:39.251825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.252881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.253470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.253924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.274606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:39.291556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:39.292445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:39.293272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:39.296955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 132/260] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:39.302852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.319862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.320971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.321393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.321806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.324342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:39.327097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:39.328979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 129/261] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:39.334857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.361178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:39.426756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:39.497127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78032ec-15cf-4e8c-9a56-de4b456b9422 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:39.530991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307aba1-bf82-4566-8f6d-de1af6710bcb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:39.567346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.568027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.568310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.568585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.569349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:39.569659 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:39.571095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:39.586755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 133/262] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:39.592145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.593149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.593938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.594254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.594531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.720217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:39.721713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:39.738466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:39.758939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cda4c-af6f-4e3b-903b-fcf30c618776 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:39.801469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:39.821588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:39.822491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:39.822777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:39.823048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] PATH_INFO: `/v3/users/1d3d49993460429d86e5625e5e7ceef6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:39.824416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] RBAC: Authorizing `identity:get_user(user_id=1d3d49993460429d86e5625e5e7ceef6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:39.828475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:39.831333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 134/263] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/users/1d3d49993460429d86e5625e5e7ceef6 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:39.835376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.892319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 130/264] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:39.900760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:39.962674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bde89c-0808-4af2-a558-5cc594863c3b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:40.023991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:40.024562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.024846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.025121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.073775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:40.083266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ae84-36c2-432b-9c55-29fece09bcc1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:40.147467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:40.149086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:40.153974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:40.154980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.155262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.155540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.156765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:40.158545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:40.160731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 131/265] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:40.167667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:40.194919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:40.348979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f3c97-e05f-43ac-af96-a058d6530b1f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:40.349180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 135/266] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:40.354175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:40.422808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:40.423920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.424414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.424886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.425945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=1d3d49993460429d86e5625e5e7ceef6) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:40.426479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:40.428138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:40.439331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 132/267] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:40 2022] GET /identity/v3/role_assignments?user.id=1d3d49993460429d86e5625e5e7ceef6&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:40.503224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:40.566016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2227f1-8e5e-4450-8fd7-c23a60673b6d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:40.616461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:40.617682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.618186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.618658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.623653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:40.625371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acc292-94a2-4b74-8883-eb11920699aa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:40.627496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 136/268] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:40 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:40.633776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:40.737091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:40.771299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422b8f9-dadb-4e3f-b263-3e689ae6da43 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:40.812628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:40.812823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.813082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.813366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.817723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=1d3d49993460429d86e5625e5e7ceef6) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:40.817723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:40.817723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f564d-8306-4584-909f-0ef9222c0a71 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:40.822812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 133/269] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:40 2022] GET /identity/v3/role_assignments?user.id=1d3d49993460429d86e5625e5e7ceef6&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1416455d2fac4316b955fc157b047ccd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:40.990183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a190-7473-4826-a739-d8ba1dc47ff6 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.990689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a190-7473-4826-a739-d8ba1dc47ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.990689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a190-7473-4826-a739-d8ba1dc47ff6 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:40.992110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 137/270] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:40.998481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858aed-832e-43af-9baa-dec38c4f9b27 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:40.998966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858aed-832e-43af-9baa-dec38c4f9b27 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:40.999247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858aed-832e-43af-9baa-dec38c4f9b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.018103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bd858aed-832e-43af-9baa-dec38c4f9b27 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:41.019335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bd858aed-832e-43af-9baa-dec38c4f9b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:41.096088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 134/271] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:41.127582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59a190-7473-4826-a739-d8ba1dc47ff6 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.133766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2533-3e3c-4497-8cf9-5015cc0c38f1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.134059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2533-3e3c-4497-8cf9-5015cc0c38f1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.134414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2533-3e3c-4497-8cf9-5015cc0c38f1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.136322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 135/272] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:41.142977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651703-d710-408f-9252-707d79430230 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.143271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651703-d710-408f-9252-707d79430230 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.143569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651703-d710-408f-9252-707d79430230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.160665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-08651703-d710-408f-9252-707d79430230 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:41.161965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-08651703-d710-408f-9252-707d79430230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:41.263721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:41.267097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59a190-7473-4826-a739-d8ba1dc47ff6 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.269874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 136/273] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:41.298445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:41.301958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651703-d710-408f-9252-707d79430230 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.313947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.314790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.315072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.315347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.326829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:41.336939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:41.339055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:41.340895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 138/274] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:41.344132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.440757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651703-d710-408f-9252-707d79430230 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.469069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc8ac-72c6-4cc7-a29a-42b95c929727 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.487099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.488638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.489107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.489562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.490962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:41.493493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:41.496336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:41.501902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.508058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.508825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.509180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.509549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.510410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:41.510786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:41.512239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:41.522262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:41.527766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.575636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:41.582463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:41.615734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f79e3-b03f-439d-aa73-6b5a96bc803b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.647304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f806f3-3908-4fa4-ac25-8eaec2351a7a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.654595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.655602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.656086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.656558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.657470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:41.659198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:41.694266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 138/277] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:45:41 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:41.695769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.696840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.697185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.697469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] PATH_INFO: `/v3/users/838b84d69f564b5999261d330b9abc74` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.715525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] RBAC: Authorizing `identity:get_user(user_id=838b84d69f564b5999261d330b9abc74)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:41.717667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0146-04d7-4dcd-9daa-2135fcab7053 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:41.719624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/users/838b84d69f564b5999261d330b9abc74 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:41.725798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:41.790249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21429f-c35b-4bfc-acd5-abe421b53dc2 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.790554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21429f-c35b-4bfc-acd5-abe421b53dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.790810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21429f-c35b-4bfc-acd5-abe421b53dc2 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.793606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 141/279] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:41.798631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276068-d812-46dc-a84c-8129b60ad07b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.798918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276068-d812-46dc-a84c-8129b60ad07b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.799224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1276068-d812-46dc-a84c-8129b60ad07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.825163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a1276068-d812-46dc-a84c-8129b60ad07b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:41.827053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a1276068-d812-46dc-a84c-8129b60ad07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:41.851726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862211b-410c-4cbb-b18e-764231a954bb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:41.880095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:41.895214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:41.895214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:41.895214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:41.895214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:41.896205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, user.id=838b84d69f564b5999261d330b9abc74, scope.system=all) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:41.896610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:41.898574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:41.904910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 139/280] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/role_assignments?user.id=838b84d69f564b5999261d330b9abc74&scope.system=all&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:41.911336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 142/281] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:41.933964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.018708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803b2f-c6f9-4668-9728-08fac39d758f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.019228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803b2f-c6f9-4668-9728-08fac39d758f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.019228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803b2f-c6f9-4668-9728-08fac39d758f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.020909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 143/282] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:42.027305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.027599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.027868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.049738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:42.050962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:42.060005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b4ce-84dc-4760-9389-e37a15be53b4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.090454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:42.111016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.112191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.112677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.113273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.128310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:42.140675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:42.141601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:42.142410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 140/283] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:42.147937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.150427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 144/284] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:42.174809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.204859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:42.263832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1831c-8f25-4029-b11e-39a5f6105c2d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.304660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fb83f-c904-40ca-b1a7-2745678cb6fd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.308560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.309549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.310570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.311045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.311995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:42.312614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:42.314243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:42.324369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 141/285] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:42.331498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.342860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.343665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.343946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.344220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.365545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:42.380320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:42.390279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:42.392203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 145/286] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:42.395806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.440329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:42.520410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b394bc-356c-4d63-9347-fda609e6bedc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.557143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.558051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.558510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.558923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.560324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:42.560767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:42.562347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:42.571342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 146/287] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:42.577355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.578722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074746-4f1a-42fe-aaa4-78928e169655 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.601691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:42.651777 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.652670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.652958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.653239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] PATH_INFO: `/v3/users/7cc740171efe4100b6155e313af0c28f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.659126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] RBAC: Authorizing `identity:get_user(user_id=7cc740171efe4100b6155e313af0c28f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:42.660336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:42.662416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 142/288] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/users/7cc740171efe4100b6155e313af0c28f => generated 297 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:42.667706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.676727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:42.687083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814da642-95ee-42d2-9fe3-d13ef7bd7999 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.754509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.755721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.756210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.756652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] PATH_INFO: `/v3/users/a0f4153e63614a5b9e56919f6fe83f88` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.759214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] RBAC: Authorizing `identity:get_user(user_id=a0f4153e63614a5b9e56919f6fe83f88)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:42.760939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:42.764573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 147/289] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/users/a0f4153e63614a5b9e56919f6fe83f88 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:42.771496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.872138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410eae4-27b2-4f26-ac4c-4660d292a68c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:42.930574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:42.930574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:42.930574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:42.930574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:42.930982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:42.930982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:42.930982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 143/290] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:42.937260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:42.954946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ab10-23a0-4ee2-9421-658211923f0c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:43.009266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:43.035761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:43.036428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:43.036712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:43.036994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:43.075381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb164d-b34a-4547-a57d-5616e93dde56 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:43.084569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:43.143867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:43.144688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:43.144968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:43.145237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/users/7cc740171efe4100b6155e313af0c28f/roles/d22c0c73fdc5451198e8f6b9e59d652c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:43.148222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, user_id=7cc740171efe4100b6155e313af0c28f, role_id=d22c0c73fdc5451198e8f6b9e59d652c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:43.149691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:43.166473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:43.170849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:43.175874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 144/291] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:45:42 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/users/7cc740171efe4100b6155e313af0c28f/roles/d22c0c73fdc5451198e8f6b9e59d652c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:45:43.326913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 148/292] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:43.333061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:43.486985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a40de-679f-400a-b385-53dbd64f0dc9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:43.495819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:43.527672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:43.528630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:43.528918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:43.529195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:43.530580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:43.532066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44f7fd-6c83-4b29-a1d3-bad5c678962c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:43.534212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 145/293] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:43 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:43.540000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:43.613122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:43.659608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6611d7-efaf-4ac7-b44a-5907aea975c4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:43.695330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:43.696000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:43.696284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:43.696561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:43.697397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=a0f4153e63614a5b9e56919f6fe83f88) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:43.697712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:43.699186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7da7-97ce-40b0-81ab-9d4a6626328d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:43.711099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 149/294] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:43 2022] GET /identity/v3/role_assignments?user.id=a0f4153e63614a5b9e56919f6fe83f88&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:44.429380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e56a-9074-4c46-b06f-e9d5aa39c270 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.429910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e56a-9074-4c46-b06f-e9d5aa39c270 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.429910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9e56a-9074-4c46-b06f-e9d5aa39c270 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.431389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 146/295] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:44.437455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.437863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.438049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.456316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:44.457487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:44.541966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:44.565536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abfc-33ce-49c9-a7b5-27ac070a0b50 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.565536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abfc-33ce-49c9-a7b5-27ac070a0b50 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.565536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8abfc-33ce-49c9-a7b5-27ac070a0b50 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.565536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 147/297] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:44.567208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:44.571447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1486b-1f34-4238-a7cc-81751a484142 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.571972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1486b-1f34-4238-a7cc-81751a484142 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.572453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1486b-1f34-4238-a7cc-81751a484142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.593951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3ac1486b-1f34-4238-a7cc-81751a484142 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:44.595795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ac1486b-1f34-4238-a7cc-81751a484142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:44.622812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:44.677701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42deb85a-3e5d-431b-ad08-5848bbf69440 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:44.683879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 148/298] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:44.702811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5c3c-7b75-4317-a02c-4b0d0c49ced5 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.703097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5c3c-7b75-4317-a02c-4b0d0c49ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.703576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5c3c-7b75-4317-a02c-4b0d0c49ced5 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.709403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 149/299] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:44.709403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5c3c-7b75-4317-a02c-4b0d0c49ced5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:44.717945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:44.718779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.719066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.719341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.729796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7d6a13bc-3364-4c91-9ea5-41cd554f18dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:44.738089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:44.738973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:44.740259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 151/300] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:44.741104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.741104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.741104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.759445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:44.760627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:44.823166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5c3c-7b75-4317-a02c-4b0d0c49ced5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:44.826951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:44.831735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 152/301] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:44.832418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:44.870946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:44.872041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.872494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.872857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.883580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:44.885201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:44.892261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:44.893118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:44.893878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:44.898328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 150/302] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:44.899015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:44.951614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8cdb6-f972-46e7-956a-3850691dc277 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:44.987276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:44.987950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:44.988240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:44.988510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:44.989259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:44.989568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:44.990997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.005101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 153/303] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.005101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.010218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b743-7de2-4d33-8ac4-30fa0e22b847 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.045127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.046004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.046379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.046663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.047840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.049300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.051147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 151/304] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.051728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.083266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:45.112118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:45.115623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b072a28-df5a-4e04-b72e-4e548364b596 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.152578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.153253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.153581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.153858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.154642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:45.154955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.156386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.158303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5b979-fd46-4a23-8203-7a952530d2f2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.164835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 154/305] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.164835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.198668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.199551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.199841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.200128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] PATH_INFO: `/v3/users/b674bd13348643adabed408f0708c7b8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.214825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] RBAC: Authorizing `identity:get_user(user_id=b674bd13348643adabed408f0708c7b8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.216811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.218607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 152/306] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:45 2022] GET /identity/v3/users/b674bd13348643adabed408f0708c7b8 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.222367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.277164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7374d-08f7-4059-91f3-8ab9046aae04 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.313630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.314339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.314630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.314910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] PATH_INFO: `/v3/groups` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.315599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.317039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.320863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:45.332409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed5243-6b4c-4361-8072-804481ca0b3f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.333232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 155/307] 10.222.0.36 () {60 vars in 1134 bytes} [Tue May 24 12:45:45 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:45.339116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.373446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.374409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.374692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.374969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] PATH_INFO: `/v3/users/838b84d69f564b5999261d330b9abc74` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.376378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] RBAC: Authorizing `identity:get_user(user_id=838b84d69f564b5999261d330b9abc74)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.378584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.384401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 153/308] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:45 2022] GET /identity/v3/users/838b84d69f564b5999261d330b9abc74 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.386940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:45.387352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:45.508538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1cf64-f079-4cb0-a9a0-25a9429b7271 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.517717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ecf2a-c4cc-40fc-b9dc-a06f2a1d044d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:45.558710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.560612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.560612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.560612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.561327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, user.id=b674bd13348643adabed408f0708c7b8, scope.system=all) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:45.561649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.563989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda3e8f-dc04-4533-a5ef-6b047306e2a1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.566260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:45.567342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.567824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.568394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] PATH_INFO: `/v3/system/users/838b84d69f564b5999261d330b9abc74/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.569932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=838b84d69f564b5999261d330b9abc74, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:45.571226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 156/309] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 24 12:45:45 2022] GET /identity/v3/role_assignments?user.id=b674bd13348643adabed408f0708c7b8&scope.system=all&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:45.571666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d474b17-bda5-472a-9c88-72f669719367 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:45.584056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 154/310] 10.222.0.36 () {58 vars in 1334 bytes} [Tue May 24 12:45:45 2022] PUT /identity/v3/system/users/838b84d69f564b5999261d330b9abc74/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:45:45.841253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaf62-9392-47cd-8d50-839ae1313115 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.841253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaf62-9392-47cd-8d50-839ae1313115 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.841824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaf62-9392-47cd-8d50-839ae1313115 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.843431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 157/311] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:45.848867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:45.849156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:45.849435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:45.867333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:45.868530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:45.887407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:45.941300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 155/312] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:45.964011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaf62-9392-47cd-8d50-839ae1313115 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:46.066985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:46.077804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaf62-9392-47cd-8d50-839ae1313115 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:46.116492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:46.117215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:46.117502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:46.117779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:46.129346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:46.138553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:46.139454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:46.140263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:46.140862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 158/313] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:46.146442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:46.250060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ca84-7458-4884-b078-eab52099fe0a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:46.286252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:46.286926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:46.287209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:46.287488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:46.288245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:46.288558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:46.289949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:46.298897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 156/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:46.304366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:46.418807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9880f93-572f-4fe6-8f82-c9633ed2c561 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:46.455700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:46.456571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:46.456854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:46.457129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] PATH_INFO: `/v3/users/7cc740171efe4100b6155e313af0c28f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:46.458346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7cc740171efe4100b6155e313af0c28f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:46.459895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:46.461567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 159/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:46 2022] GET /identity/v3/users/7cc740171efe4100b6155e313af0c28f => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:46.467231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:46.487340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:46.572040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91280-e92a-44d5-a996-862a53688140 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:46.609723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:46.610495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:46.610877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:46.611155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:46.681904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:46.683338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:46.698867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:46.789910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 157/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:45:46.795941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:46.813730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:46.905982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abe327-fdc4-4fcf-9df8-0a16a4d6b5f0 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:46.941599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:46.942421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:46.942701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:46.942976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:46.944166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:46.945671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4548545-4d9a-4b0e-b3aa-064c8e5b36d1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:46.947513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 160/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:46 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:46.953330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:47.056019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b7143-193b-40cc-be7c-b73d58a300bb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:47.074527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:47.091956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:47.092783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.093132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.093645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.094506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, scope.project.id=86b0342aabe54399b80d777042ef1940, user.id=7cc740171efe4100b6155e313af0c28f) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:47.094816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:47.096256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6796-e422-4c8f-b0d4-47ee15b4e92c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:47.102664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 158/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:45:46 2022] GET /identity/v3/role_assignments?user.id=7cc740171efe4100b6155e313af0c28f&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:47.690601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367f2f-d132-4f24-9deb-67149ad2f642 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.690958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367f2f-d132-4f24-9deb-67149ad2f642 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.691077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367f2f-d132-4f24-9deb-67149ad2f642 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.692529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 161/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:47.698579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24842ba-c45c-4ac6-b7fd-0d98b15af1e9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.699082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24842ba-c45c-4ac6-b7fd-0d98b15af1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.699153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24842ba-c45c-4ac6-b7fd-0d98b15af1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.716840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b24842ba-c45c-4ac6-b7fd-0d98b15af1e9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:47.718029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b24842ba-c45c-4ac6-b7fd-0d98b15af1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:47.791840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 159/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:47.814321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e367f2f-d132-4f24-9deb-67149ad2f642 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:47.871406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001a93-a39f-4c62-99ef-8a1b3f1d927b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.871698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001a93-a39f-4c62-99ef-8a1b3f1d927b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.872696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001a93-a39f-4c62-99ef-8a1b3f1d927b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.878179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 160/321] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:47.879416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff88c-7183-459a-93c9-544bcd793ee6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.879706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff88c-7183-459a-93c9-544bcd793ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.880197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff88c-7183-459a-93c9-544bcd793ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.897158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-649ff88c-7183-459a-93c9-544bcd793ee6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:47.898429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-649ff88c-7183-459a-93c9-544bcd793ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:47.904805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:47.926982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e367f2f-d132-4f24-9deb-67149ad2f642 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:47.960810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:47.961527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.961817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.962095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.963285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:47.964736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:47.965259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 161/322] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:47.971047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 162/323] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:47.971182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab31f4-2234-44e6-9be1-5e1da78f2a2c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.971182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab31f4-2234-44e6-9be1-5e1da78f2a2c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.971182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab31f4-2234-44e6-9be1-5e1da78f2a2c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.971182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 162/324] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:47.971931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:47.973745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:47.974032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:47.974350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:47.993695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:47.994895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:48.024761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.062335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 163/325] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:48.063164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.074186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2bd02-4d55-4159-9260-85469b9efcd4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.108337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.109001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.109288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.109568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] PATH_INFO: `/v3/groups` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.110292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.111727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.125262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 163/326] 10.222.0.36 () {60 vars in 1134 bytes} [Tue May 24 12:45:47 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:45:48.126273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.142574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.185384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf60ee-a25f-425e-b6d4-311c3a104dab None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.226105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.227456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.227738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.228009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.241209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:48.249790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:48.250757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:48.251557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:48.256066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 164/327] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:48.257035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.258776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f170-6832-4199-8edb-cce1c103966c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.288676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.300431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.301246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.301530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.301939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.314885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:48.323015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:48.323853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:48.324635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:48.330256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.380057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c417420-b517-4a5d-9af5-df873ea15aeb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.416144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.431384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.432064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.432344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.432627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.433378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:48.433687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.435827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.445029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 165/329] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:48.450838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.459489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d12190-6f1e-43f4-b8e6-18752bf21978 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.498624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.499064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.499297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.499576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.500339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:48.500897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.504354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.515969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 165/330] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:48.522005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.564510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.577255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77582f6-9e49-44bd-ab07-81f6fec4111b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.621811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.624360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.624360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.624360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] PATH_INFO: `/v3/users/838b84d69f564b5999261d330b9abc74` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.626576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] RBAC: Authorizing `identity:get_user(user_id=838b84d69f564b5999261d330b9abc74)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.627781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.629614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/users/838b84d69f564b5999261d330b9abc74 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:48.635359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.654995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dd7e1-4743-4046-99b8-2cca4b955db4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.689269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:48.697279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.698339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.698704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.698992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] PATH_INFO: `/v3/users/b674bd13348643adabed408f0708c7b8` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.701657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] RBAC: Authorizing `identity:get_user(user_id=b674bd13348643adabed408f0708c7b8)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.703170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.705957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/users/b674bd13348643adabed408f0708c7b8 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:48.711668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:48.774960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86d1d5-e057-4223-b2d9-ed1f11e5289b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.818102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.818537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.818827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.819110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.819948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] RBAC: Adding query filter params (role.id=1cb9e903cea946bbaf62dfaa5743dadb, user.id=838b84d69f564b5999261d330b9abc74, scope.system=all) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:48.820265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.821788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab83dfa-08bc-464f-b838-517ae5e64ef0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.838543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 24 12:45:48 2022] GET /identity/v3/role_assignments?user.id=838b84d69f564b5999261d330b9abc74&scope.system=all&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:48.848097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6d0b-3da6-4d8d-9745-8101ffb3063b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:48.889178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:48.890477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:48.890962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:48.891434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] PATH_INFO: `/v3/system/users/b674bd13348643adabed408f0708c7b8/roles/d22c0c73fdc5451198e8f6b9e59d652c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:48.893209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b674bd13348643adabed408f0708c7b8, role_id=d22c0c73fdc5451198e8f6b9e59d652c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:48.894953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc24ade-978a-4cd1-ba7d-60b978abbcad None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:48.908918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 167/334] 10.222.0.36 () {58 vars in 1334 bytes} [Tue May 24 12:45:48 2022] PUT /identity/v3/system/users/b674bd13348643adabed408f0708c7b8/roles/d22c0c73fdc5451198e8f6b9e59d652c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:45:50.835529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce4b6-b839-42fa-b0cd-597d49276c37 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:50.836085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce4b6-b839-42fa-b0cd-597d49276c37 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:50.836085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce4b6-b839-42fa-b0cd-597d49276c37 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:50.837548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 168/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:50.843688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b33f3-be85-4527-b794-d4e89d99e119 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:50.844182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b33f3-be85-4527-b794-d4e89d99e119 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:50.844284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b33f3-be85-4527-b794-d4e89d99e119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:50.870241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-609b33f3-be85-4527-b794-d4e89d99e119 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:50.871437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-609b33f3-be85-4527-b794-d4e89d99e119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:50.954634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:50.967620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:50.991475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce4b6-b839-42fa-b0cd-597d49276c37 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.015876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:51.119462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce4b6-b839-42fa-b0cd-597d49276c37 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:51.152808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b410d-5fe8-42be-afee-eaa811503dc6 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.153213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b410d-5fe8-42be-afee-eaa811503dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.153600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b410d-5fe8-42be-afee-eaa811503dc6 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.155330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 169/337] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:51.161036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.161328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.161632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.172038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:51.173367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.173871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.174374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.188382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:51.189572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:51.191795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:51.200546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:51.201430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:51.202244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 169/338] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:51.209411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.299478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:51.301418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:51.321775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c140cf-fe7d-47d6-bbf9-1865dbb6b644 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:51.363181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:51.364234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.364724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.365225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.366206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:51.366713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:51.368301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:51.374379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.379197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 170/340] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:51.385031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.553414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ce8b-8986-4c40-b3e5-d20155e402cc None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:51.574419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde63830-0e59-42c6-b2b2-92644ccd418b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:51.603565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:51.627680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:51.628408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.628689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.628961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.644778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:51.645441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:51.645724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:51.646003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:51.657727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:51.667722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:51.668600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:51.670564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 171/341] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:51.682476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:51.682750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.794742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:51.796447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:51.921259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28858b-4206-4adf-9dde-cf39e1fdc389 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:51.943549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 171/342] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:45:51.949837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:51.994489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:51.999496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.000404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.001325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.001750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.003218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:52.003763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.005299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.015471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 172/343] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:52.030002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.067138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4efe5-9662-4942-9498-deca15d8eaa7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.101821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:52.105935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.107653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.108090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.108504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.109892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.112675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ebd97-9a3e-4e48-b950-7ca8a49dc234 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.114687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 172/344] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:51 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:52.116141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978598-0ba5-4d08-8629-8816e26a3cf5 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.116568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978598-0ba5-4d08-8629-8816e26a3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.116987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978598-0ba5-4d08-8629-8816e26a3cf5 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.122936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 173/345] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:52.124635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978598-0ba5-4d08-8629-8816e26a3cf5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.189878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15ac8d-1134-48d1-9cf2-3ddc78d0348f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.231622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.232286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.232570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.232845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.243524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978598-0ba5-4d08-8629-8816e26a3cf5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.255440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:52.295841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.297267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.297955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.298572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.306560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.308668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2085-cee1-4741-b37b-c6824084bcd6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.312247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 174/346] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:52.318305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6627-be16-41ab-9134-376e6943bfbb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.318305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6627-be16-41ab-9134-376e6943bfbb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.318305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6627-be16-41ab-9134-376e6943bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.338870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.340355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9621b-6565-4485-97a3-d05974a78f1a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.355530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-974f6627-be16-41ab-9134-376e6943bfbb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:52.358450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-974f6627-be16-41ab-9134-376e6943bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:52.417270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:52.467768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 175/347] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:52.469478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d52f-7cf8-4e53-a861-7ed5739fc934 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.469994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d52f-7cf8-4e53-a861-7ed5739fc934 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.471595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d52f-7cf8-4e53-a861-7ed5739fc934 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.476831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 176/348] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:52.478841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7d52f-7cf8-4e53-a861-7ed5739fc934 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.551707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 173/349] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:45:52.553619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.554138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.555150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.582667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:52.585123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:52.618128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:52.622933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7d52f-7cf8-4e53-a861-7ed5739fc934 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.666494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.667452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.667880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.669273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.670483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=17619838f5334aa7affd20448ae3306b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:52.670993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.672671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.679605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 174/350] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:52.682458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.682562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 177/351] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1416455d2fac4316b955fc157b047ccd => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:52.682562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.812566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:52.847731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c827-6129-4061-8886-2d46cc26e7fd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.853478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec8751-f8e6-4424-9dee-f67bb876c6c6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:52.899509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.900710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.901230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.901714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.901834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:52.903680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.903968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.904245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.906637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:52.909299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:52.912589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 178/352] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:52.916841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:52.920702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-66b1ac9d-a61b-499f-87c5-10063429098b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:52.930845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:52.932175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 12:45:52.933029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:52.938081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 175/353] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:52.939815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9621a3-7d4f-49b6-b5e3-c096cb00e8e4 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:52.940107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9621a3-7d4f-49b6-b5e3-c096cb00e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:52.940387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9621a3-7d4f-49b6-b5e3-c096cb00e8e4 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:52.944678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 176/354] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:52.945266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9621a3-7d4f-49b6-b5e3-c096cb00e8e4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:52.981207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.091612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1e845-3208-4a78-9fb8-e85092829aec None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.106655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9621a3-7d4f-49b6-b5e3-c096cb00e8e4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.151511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.151845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.152717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.152839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.152935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.153050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.153345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.153787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.155100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:53.156631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:53.158683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 177/355] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:53.159530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.167366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:53.168503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ffb0e8b9-4db2-443d-b27a-fc799030fe8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:53.183870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:53.185512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:53.186331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:53.187538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 179/356] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:53.192094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.192094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.192094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.212342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:53.216153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:53.289839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9c15f-2d1d-47c6-ac57-6a820846462a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.312602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 180/357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:53.313292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.343713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.349582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.350292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.350580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.350853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.351771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:53.352077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:53.353466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:53.368833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 178/358] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:53.370972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.471725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868325c-2b9c-4b99-922c-8f254a86cb21 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.480877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.519673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.520613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.521057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.521483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.522752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=17619838f5334aa7affd20448ae3306b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:53.523104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1572dd-58bf-40cc-a78c-f748ae671ab1 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.523404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:53.525119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:53.531925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 181/359] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:53.538189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.565507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.566225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.566510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.566786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.567552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:53.567858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:53.569286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:53.587860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 179/360] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:53.589058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.692820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.711337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88598-aeb6-4258-836a-6cc3f710272c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.750049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed373-eb55-43b2-ae54-f97a2cb6a4d6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.754409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.755247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.755635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.755917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.770929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:53.779954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:53.780895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:53.781689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 182/361] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:53.783510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.786416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:53.803592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.805009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.805633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.806161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] PATH_INFO: `/v3/users/b674bd13348643adabed408f0708c7b8` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.808801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] RBAC: Authorizing `identity:get_user(user_id=b674bd13348643adabed408f0708c7b8)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:53.810605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292ed99-4743-41d9-877d-1251bba82582 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:53.813471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 180/362] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/users/b674bd13348643adabed408f0708c7b8 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:53.815257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c72c-dbd0-4fcd-9c28-4bd5c175202f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.815765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c72c-dbd0-4fcd-9c28-4bd5c175202f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.816694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c72c-dbd0-4fcd-9c28-4bd5c175202f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.819092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 181/363] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:53.820725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732c72c-dbd0-4fcd-9c28-4bd5c175202f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:53.914035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b046-6ec1-499c-92be-62c946c2b670 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.958193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:53.958838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:53.959119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:53.959445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:53.962847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732c72c-dbd0-4fcd-9c28-4bd5c175202f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:53.979767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.009510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.010390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.010787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.011160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.012008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:54.012444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.013917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.025432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 182/364] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:54.026587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.050612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.053392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bc44-e858-49dd-b29a-dc055645db90 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.110503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.144769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0965727-b319-4dc2-a761-d66491269d1e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.184501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.185348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.185729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.186099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.187145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] RBAC: Adding query filter params (role.id=d22c0c73fdc5451198e8f6b9e59d652c, user.id=b674bd13348643adabed408f0708c7b8, scope.system=all) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:54.187551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.189079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.191085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 183/365] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:54.193034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.193641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.194094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.207622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 183/366] 10.222.0.36 () {56 vars in 1308 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/role_assignments?user.id=b674bd13348643adabed408f0708c7b8&scope.system=all&role.id=d22c0c73fdc5451198e8f6b9e59d652c => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:54.208755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.227686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:54.228945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:54.286992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.320451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 184/367] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:54.321427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.458088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc98506-6f80-42fb-8946-4579cec638cc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.486201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.497909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ba29-9816-49f8-8643-3846faa07d7c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.516882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.517554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.517842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.518140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.539651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.541157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.541595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.542033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.543403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.547959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.551155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 185/368] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:54.552171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.605672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.607935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.609572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.682079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04302c3-9f68-4e99-8613-2b10558f825d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.716893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 184/369] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:54.719585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.723210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.724245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.724725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.725186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.737301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.737632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:54.746903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:54.747910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:45:54.748708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:54.751243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 186/370] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:54.752369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.826073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26e408-b972-4502-a4c1-0c226318009f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.862170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.863006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.863287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.863561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.864724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.866172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.867955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 185/371] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:54.868522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4af4-b1e8-4582-8c24-007783c01e4e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:54.868711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.871490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.911034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:54.912183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:54.912616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:54.913038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:54.914583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:54.916320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:54.918894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 187/372] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:54.920255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:54.961850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:54.991774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed685-011d-4a67-926b-e022bbb29866 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.035888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.037194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.037624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.038066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.039020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:55.040040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.041874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.057287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3890503-4768-4689-af5e-31daccbe5afb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.057884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 186/373] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.059373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.103525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.104188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.104471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.104749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.105591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=86b0342aabe54399b80d777042ef1940) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:55.106060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.107795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.117227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 188/374] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:45:54 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.118359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.166468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:55.205115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51163b-b7e4-4c28-aaeb-467c262bc0e6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.251647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c934cd-2c56-4155-984c-24c6bba8b2fd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.255039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.256132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.256587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.257011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.258803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.260435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.264470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 187/375] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.271449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.294552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:55.299315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.300137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.300527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.300953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.397161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.398890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2bc-7be0-44c0-a7fd-90a111de6414 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.417914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f5e8-f35b-4f50-b3ad-65f83cbafa1c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.461743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:55.478150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.478739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.480451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.480637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.481587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=86b0342aabe54399b80d777042ef1940) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:55.481904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.487094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.502774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 188/376] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1416455d2fac4316b955fc157b047ccd => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.563054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 189/377] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:45:55.569226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.663584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103059c6-703d-461f-8f31-c428798ed503 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.663983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103059c6-703d-461f-8f31-c428798ed503 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.664160 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103059c6-703d-461f-8f31-c428798ed503 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.665828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 190/378] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:55.666864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:55.672739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.673048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.673260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.696927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79bf4-7760-420b-94ee-7b8bf43b5204 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.709894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:55.711171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:55.756751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.757818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.758102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.759365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] PATH_INFO: `/v3/projects/e6f1e0d8c1cd468ea817eb192b478192` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.760795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6f1e0d8c1cd468ea817eb192b478192)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.762642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.764837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 189/379] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/projects/e6f1e0d8c1cd468ea817eb192b478192 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.771032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.854824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 191/380] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:55.895401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:55.910689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b48feb-c453-4b9d-80a5-5f8abf4381e3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:55.952290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:55.953166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:55.953445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:55.953714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] PATH_INFO: `/v3/groups/6b8fa6d932544cfebf04f86c2070f829` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:55.970623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] RBAC: Authorizing `identity:get_group(group_id=6b8fa6d932544cfebf04f86c2070f829)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:55.972110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:55.974427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 190/381] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/groups/6b8fa6d932544cfebf04f86c2070f829 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:55.982097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.005051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.017074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.071046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8bec-2961-4932-b9c5-b9707cff1881 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.122246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.123180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.123472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.123750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.125206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36775cce-2020-496d-95e8-3fb23fb0ebbc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.147893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:56.161946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:56.163932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:56.165316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 192/382] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:56.170472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.170686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.171297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.171686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.171967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.172808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] RBAC: Adding query filter params (group.id=6b8fa6d932544cfebf04f86c2070f829, role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=e6f1e0d8c1cd468ea817eb192b478192) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:56.173122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:56.174730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a3bc8-b05c-43a9-b33d-aad8eb848c85 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:56.181330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 191/383] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:45:55 2022] GET /identity/v3/role_assignments?group.id=6b8fa6d932544cfebf04f86c2070f829&scope.project.id=e6f1e0d8c1cd468ea817eb192b478192&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:56.312733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861106-7bf7-4534-aff9-3f5358897345 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.313022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861106-7bf7-4534-aff9-3f5358897345 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.313304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0861106-7bf7-4534-aff9-3f5358897345 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.315017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 192/384] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:45:56.320352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.320643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.320928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.345436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:56.346670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:56.352372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73ed6e-62f0-45ba-9eea-8a4262dfbf6f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.394184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.399809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.400526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.400809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.401401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.402284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:56.402613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:56.409094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:56.414672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 193/385] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:56.439331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.468868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 193/386] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:56.502072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.511469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.586760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531f8-2885-40ef-b913-dc91a44b57bd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.628661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.629536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.629818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.630097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.631480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:56.633304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:56.635586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 194/387] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:56.641007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.659060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fa6f3-4ac1-4cdc-a8ce-d7c25d16b15e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.694734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.695556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.695834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.696109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.707134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.709174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:56.718994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:56.721090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:45:56.723158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 194/388] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:56.730146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.758144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4656b-6c9d-4d45-acae-06eccc4fa5df None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.796469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:56.800955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.801893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.802156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.802593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.804554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:56.806268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:56.808216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 195/389] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:56.815519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.841648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20b6e-e780-4ad1-ae90-b780e6bdb16b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:56.880594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:56.881275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:56.881560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:56.881841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:56.882885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:56.883192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:56.884572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:56.895892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 195/390] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:56.904403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:56.975237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4879c-289f-4839-97ff-e139dff4ffdb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:57.007065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:57.020813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfde8-8a2c-4cdd-96b1-2410270ff291 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:57.031463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:57.032371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:57.032653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:57.032934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:57.039973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, group_id=736fa02ed99e4bc59ec9f006c5ade826, role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:57.041428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:57.061796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:57.062933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:57.063221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:57.064001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:57.065304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:57.067076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:57.068710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 196/391] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 24 12:45:56 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1416455d2fac4316b955fc157b047ccd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:57.069383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 196/392] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:56 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:57.069626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:57.075862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:57.223537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548366fd-69c2-493a-bbe0-e7648fee4aec None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:57.269893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:57.270810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:57.271096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:57.271404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:57.274969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:57.276714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d36025-f182-4124-a372-c723084a68b3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:57.279103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 197/393] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:57 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:57.286721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:57.412466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52aea-aa38-4342-8eaa-6a060f207376 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:57.448857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:57.449930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:57.450392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:57.450865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:57.452872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] RBAC: Authorizing `identity:create_grant(project_id=17619838f5334aa7affd20448ae3306b, group_id=736fa02ed99e4bc59ec9f006c5ade826, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:57.454410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52861b03-9b2c-4953-adf0-f1d80afe229e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:57.471388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 197/394] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 24 12:45:57 2022] PUT /identity/v3/projects/17619838f5334aa7affd20448ae3306b/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:58.032661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10ef7-f51f-4498-b78f-8ce9e3cff198 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.033048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10ef7-f51f-4498-b78f-8ce9e3cff198 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.033406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10ef7-f51f-4498-b78f-8ce9e3cff198 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.035530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 198/395] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:58.041508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.042212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.042373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.066417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:58.067623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:58.134841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:58.159413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 198/396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:45:58.190587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10ef7-f51f-4498-b78f-8ce9e3cff198 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:58.250815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:58.312317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10ef7-f51f-4498-b78f-8ce9e3cff198 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:58.354431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:58.355238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.355521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.355796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.370788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:58.381234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:58.383540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:58.385415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:45:58.392047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:58.505372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524bcce-bc08-44f7-bf1c-d71ff113f241 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:58.543908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:58.544902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.545229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.545506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.546294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:58.546601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:58.547985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:58.557026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 199/398] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:58.563166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:58.699677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b382-88eb-4ccb-b57c-5da2424186ee None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:58.716723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:58.742066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:58.742969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.743251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.743530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.744766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:58.746301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a206e0-0cf7-4dac-a89c-4f5251595b6c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:58.748799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 200/399] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:58 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:58.754628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:58.819155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:58.883827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b6ae-f586-487c-9049-29ef496b1886 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:58.888483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417706-8cc4-44b9-9e21-545ba8fc12ec None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.888774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417706-8cc4-44b9-9e21-545ba8fc12ec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.889050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a417706-8cc4-44b9-9e21-545ba8fc12ec None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.890481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 201/400] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:58.897118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.897118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.897118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.927453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:58.928319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:58.933374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:58.933374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:58.933374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:58.933374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:58.933646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 200/401] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:58 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:58.942293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:58.945537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:58.946992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:59.079225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 202/402] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:59.126675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde2f8a-a9d0-476b-b50d-875a3aee2b55 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:59.133172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:59.170487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:59.265901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbf83f-7ab7-4973-9140-353133faed7f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:59.270879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:59.271795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.272080 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.272357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.277649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:59.278963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, group_id=736fa02ed99e4bc59ec9f006c5ade826, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:59.280431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:59.320205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 201/403] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 24 12:45:58 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:45:59.321208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:59.322209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.322498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.322879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.347878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:45:59.360895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:45:59.361829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:45:59.362656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 203/404] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:45:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:45:59.368013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:59.549104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabcb5a-fef8-4e36-b8ee-7e60aca583ab None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:59.593074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:59.593757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.594042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.594381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.595142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:45:59.595456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:59.596840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75dc34-6fa2-4014-8e52-5cab377c88b3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:59.609585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 202/405] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:45:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:45:59.614818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:59.726862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7dca-d69b-4288-a369-6bbd5eb9269a None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.727217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7dca-d69b-4288-a369-6bbd5eb9269a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.727426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7dca-d69b-4288-a369-6bbd5eb9269a None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.729057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 203/406] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:45:59.734448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.734741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.735022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.753886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:45:59.755162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:45:59.764353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252eeb-8461-413e-838c-5903afc635da None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:45:59.787678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:59.815865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:45:59.816739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:45:59.817031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:45:59.817309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:45:59.818536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:45:59.820025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:45:59.821993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 204/407] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:45:59 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:45:59.827574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:59.877074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 204/408] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:45:59.882746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:45:59.904477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:45:59.969947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078525-f05f-401b-91aa-9d52f1ee73be None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.007093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.008331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.008623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.008903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.010185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.011906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.014529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 205/409] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:45:59 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:00.020434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.097464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0a29-d04d-4716-bdda-5e9ef99a065b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.145064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.146355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.146839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.147263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.159422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a3f6b-5b0b-410f-a5f8-ba7a69e4c92b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.163345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:00.167811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-29540c29-421f-42fc-a1b6-a1af48426c22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:00.174769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:00.175648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:00.176423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 205/410] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:00.177220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4824-389a-4eee-a79d-6eeff5e6ad35 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.177666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4824-389a-4eee-a79d-6eeff5e6ad35 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.178071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4824-389a-4eee-a79d-6eeff5e6ad35 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.179523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 206/411] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:00.183348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4824-389a-4eee-a79d-6eeff5e6ad35 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.208397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.209448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.209830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.210539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.212715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b0342aabe54399b80d777042ef1940, group_id=736fa02ed99e4bc59ec9f006c5ade826, role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.214330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab3a5c-e613-4dac-a53a-700be9802916 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.221864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.238139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 206/412] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 24 12:46:00 2022] PUT /identity/v3/projects/86b0342aabe54399b80d777042ef1940/groups/736fa02ed99e4bc59ec9f006c5ade826/roles/1416455d2fac4316b955fc157b047ccd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:00.238139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.238139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.238139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.277290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:00.280074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:00.371102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 207/413] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:00.395776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4824-389a-4eee-a79d-6eeff5e6ad35 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.395946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.450196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.450890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.451171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.451443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.452211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:00.452518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.453936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.480540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 207/414] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:00.487871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.552446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.561909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794d7d4-d6eb-49f6-9630-52ae1e55a1ad None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.597526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.611692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa274-7080-4e5d-bd62-1db0723cb43d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.617898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.619070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.619483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.619769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.634453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c232ad66-66f4-48d9-bdbd-861848b72894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:00.649473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:00.650474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:00.651242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 208/415] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:00.652446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862421-5afb-4af0-ae55-7cf540cfbf92 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.652778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862421-5afb-4af0-ae55-7cf540cfbf92 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.653074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862421-5afb-4af0-ae55-7cf540cfbf92 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.654395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 209/416] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:00.654765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.655843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.656551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.657024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] PATH_INFO: `/v3/groups/6b8fa6d932544cfebf04f86c2070f829` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.658460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] RBAC: Authorizing `identity:get_group(group_id=6b8fa6d932544cfebf04f86c2070f829)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.659118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862421-5afb-4af0-ae55-7cf540cfbf92 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.660570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c980c8c-c4bf-4080-a9b2-56a2d250d21c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.662717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 208/417] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/groups/6b8fa6d932544cfebf04f86c2070f829 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:00.664097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.664585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.665081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.683704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:00.685746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:00.764557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 209/418] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:00.765757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.770692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862421-5afb-4af0-ae55-7cf540cfbf92 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.807117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.807853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.808134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.808404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.809864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:00.810209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.811624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.820449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 210/419] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:00.821286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.849477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.871220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:00.891577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacd3a-779d-4e2c-be80-f7a3a39d13f7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.934654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.936240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:00.936527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:00.937072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] PATH_INFO: `/v3/projects/e6f1e0d8c1cd468ea817eb192b478192` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:00.938439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] RBAC: Authorizing `identity:get_project(project_id=e6f1e0d8c1cd468ea817eb192b478192)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:00.938977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0f03-2d26-46d3-86f3-c26aaf0b1835 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:00.939887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:00.942709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 210/420] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/projects/e6f1e0d8c1cd468ea817eb192b478192 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:00.943343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:00.998683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:00.999759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.000048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.000900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.014821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:01.025521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:01.026499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:46:01.027280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:01.028510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 211/421] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:01.029244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.065704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80cf41-e05d-4a52-a295-9229b61ed5da None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.102318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.102972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.103423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.103845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.132043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:01.135152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:01.159245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3c6a6-9b53-4570-8752-ad522a730ea6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.186564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.188706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.195220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.196267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.196617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.196961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] PATH_INFO: `/v3/projects/e6f1e0d8c1cd468ea817eb192b478192/groups/6b8fa6d932544cfebf04f86c2070f829/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.199782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6f1e0d8c1cd468ea817eb192b478192, group_id=6b8fa6d932544cfebf04f86c2070f829, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.202355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.226213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 212/422] 10.222.0.36 () {58 vars in 1442 bytes} [Tue May 24 12:46:01 2022] PUT /identity/v3/projects/e6f1e0d8c1cd468ea817eb192b478192/groups/6b8fa6d932544cfebf04f86c2070f829/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:01.228114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.395548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 211/423] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:01.401412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.476731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:01.479080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71bb2-e7e0-4886-a950-69837f0bdf88 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.524676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.525644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.525930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.526378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.527462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:01.527836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.529826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.533853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2ad4e-78ee-4b17-8f38-8b6f06ed4dd3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.536580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:01.541933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:01.549175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.598884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.599760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.600043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.600319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.602480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.603925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.605662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:01 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:01.620194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.729604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4188cf-cab0-4795-967f-121384744c4d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.774849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.775518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.775806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.776085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.817825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad98d2-495c-446b-8ef5-3bc3d5e65e52 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:01.860776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:01.881648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:01.882808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:01.883094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:01.883369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:01.885559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.887075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.891344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 213/426] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:01 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:01.896122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:01.913890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:01.915553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:01.922457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.012908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4edc-0dfe-46de-a42e-108b19cfc11e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.054245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.055353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.055759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.056042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.057035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=17619838f5334aa7affd20448ae3306b) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:02.057358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.060098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9522f-6839-45b8-8b13-1443ae0de262 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:02.068432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 214/427] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:46:01 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1416455d2fac4316b955fc157b047ccd => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:02.069755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd678f-9e01-46da-b8a7-9f108f453f83 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.070047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd678f-9e01-46da-b8a7-9f108f453f83 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.070360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd678f-9e01-46da-b8a7-9f108f453f83 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.072366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 215/428] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:02.078371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.078755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.078974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.102210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 214/429] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:02.103350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:02.104565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:02.109166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.228091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.280488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.286139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 216/430] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:02.288944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b207ce-efcf-4129-9ab9-fdb6c1ca1bb2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.325720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.339035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.340811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.341280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.341760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] PATH_INFO: `/v3/projects/17619838f5334aa7affd20448ae3306b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.344181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=17619838f5334aa7affd20448ae3306b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.345828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:02.348082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 215/431] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/projects/17619838f5334aa7affd20448ae3306b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:02.353455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.466464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3888-4ed5-4594-acdf-1c5b4319e00c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.512555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.513746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.514285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.514785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.525676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:02.525819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0efef4-3df6-4016-913a-885e1dbbc2d4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:02.535288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:02.536185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 12:46:02.536973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:02.539733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 217/432] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:02.545533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.580913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.581770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.582266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.582795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.584183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.585818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:02.587686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 216/433] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:02.594074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.599806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.635069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.660127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf4659-0143-4f69-97e2-9be1b9bdb545 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.696441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.697447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.697946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.698599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.700325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:02.700888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.702622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:02.717184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3fb1c-615d-4f0c-901e-fb2debe3df26 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.717933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 218/434] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:02.719195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:02.753374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.754044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.754354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.754628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.755632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=17619838f5334aa7affd20448ae3306b) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:02.755946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.757714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cbc60-6d21-4f03-b25b-09ea12dfd098 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:02.768818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 217/435] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=17619838f5334aa7affd20448ae3306b&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:02.836982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca7e4-718f-4a8c-a17f-d390b2ee53b9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:02.845363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:02.879181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:02.880088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.880546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.880965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.903817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0bf73-808c-4d8b-abdc-2c2582655745 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.904112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0bf73-808c-4d8b-abdc-2c2582655745 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.904400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0bf73-808c-4d8b-abdc-2c2582655745 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.905852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 218/436] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:02.911505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:02.911798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:02.912365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:02.930440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:02.931867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:02.974016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:02.975518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.030370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 219/437] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:03.054226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.098707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.109387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 219/438] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:03.114603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.124998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.197367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1001-ad74-4f3a-8015-a95be3c1bb46 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.246136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df62b2-13d3-4ce3-8e70-9ac6ba190127 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.254285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.255100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.255720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.255720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.268347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:03.279142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:03.280209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:03.281186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:03.283274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 220/439] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:03.289620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.290501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.291376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.291651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.291918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.293210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:03.296973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.298698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 220/440] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:03.311666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.413127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.416271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.428810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ea97b-9053-4710-bf6a-014202063330 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.447329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125c94-ecca-42a5-8a94-01ca85647a74 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.468259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.469163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.469449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.469724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.470505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:03.470813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:03.472188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.482389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 221/441] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:03.487916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.495355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.496221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.497238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.498102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.499406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:03.500840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.502814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 221/442] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:03.508618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.615794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc1e42-57dc-4e15-8836-0968fba741cb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.623816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c670a-9820-40ee-97ff-366e2f141685 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:03.657084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b188-fba7-497e-8245-141187db7afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.657738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b188-fba7-497e-8245-141187db7afc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.658039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b188-fba7-497e-8245-141187db7afc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.658345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b188-fba7-497e-8245-141187db7afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.661774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:03.662647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.662937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.663217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.664053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1cb9e903cea946bbaf62dfaa5743dadb, scope.project.id=86b0342aabe54399b80d777042ef1940) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:03.664369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:03.665799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb1801-1578-4532-83bf-9e528cf5c22e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.678772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 222/443] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1cb9e903cea946bbaf62dfaa5743dadb => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:03.683168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.739269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b188-fba7-497e-8245-141187db7afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:03.740768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b188-fba7-497e-8245-141187db7afc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:03.788576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037553-ccb5-42c5-bbf0-29aacdff3618 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.789356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037553-ccb5-42c5-bbf0-29aacdff3618 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.789649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037553-ccb5-42c5-bbf0-29aacdff3618 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.791472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 223/444] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:03.797933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:03.798461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:03.798944 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:03.811560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.818083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:03.819347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:03.859017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 222/445] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:03.864520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b188-fba7-497e-8245-141187db7afc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.898283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 224/446] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:03.921757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:03.922314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:03.980952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b188-fba7-497e-8245-141187db7afc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.022538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.022765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.023033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.023309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] PATH_INFO: `/v3/projects/86b0342aabe54399b80d777042ef1940` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.024502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] RBAC: Authorizing `identity:get_project(project_id=86b0342aabe54399b80d777042ef1940)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.025980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.029910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 223/447] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/projects/86b0342aabe54399b80d777042ef1940 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:04.033824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.045677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2c1d-554a-4f68-93a3-596a331ef626 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.084331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.085161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.085447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.085724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.088363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:04.097337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:04.105043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:04.106609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:04.107665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:04.112457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.144268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f046e-c78d-43b8-b000-fa3620a47e52 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.164484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:04.179553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.180340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.180621 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.180894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] PATH_INFO: `/v3/groups/736fa02ed99e4bc59ec9f006c5ade826` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.182057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] RBAC: Authorizing `identity:get_group(group_id=736fa02ed99e4bc59ec9f006c5ade826)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.183562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.185452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 224/449] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/groups/736fa02ed99e4bc59ec9f006c5ade826 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:04.191233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.213308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c2a7-e1d0-4ed6-b3ec-032fd7b4f970 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.247668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.248328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.248611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.248893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.249640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:04.249949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.251363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.259988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 226/450] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:04.265573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.289998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa5a-bf7c-4710-baf7-06fe2c95e4bf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.322620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:04.325862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.326659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.326954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.327216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.328136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] RBAC: Adding query filter params (group.id=736fa02ed99e4bc59ec9f006c5ade826, role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=86b0342aabe54399b80d777042ef1940) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:04.328438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.330099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.342168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 225/451] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/role_assignments?group.id=736fa02ed99e4bc59ec9f006c5ade826&scope.project.id=86b0342aabe54399b80d777042ef1940&role.id=1416455d2fac4316b955fc157b047ccd => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:04.368730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85116-7aba-4397-9ffd-2a23026ba70c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.407545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.408214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.408584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.408758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.481077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.482597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.541680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:04.587314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 227/452] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:46:04.594099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.648796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:04.697384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107eade-2be3-4425-ac85-2e7e48c39846 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.732320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.733107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.733388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.733660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] PATH_INFO: `/v3/projects/e6f1e0d8c1cd468ea817eb192b478192` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.734858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] RBAC: Authorizing `identity:get_project(project_id=e6f1e0d8c1cd468ea817eb192b478192)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.736294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.738000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 226/453] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/projects/e6f1e0d8c1cd468ea817eb192b478192 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:04.743469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.841174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32274-a754-4582-b4a6-196b0458ee60 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:04.874643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:04.875490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:04.875773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:04.876049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] PATH_INFO: `/v3/groups/6b8fa6d932544cfebf04f86c2070f829` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:04.877202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] RBAC: Authorizing `identity:get_group(group_id=6b8fa6d932544cfebf04f86c2070f829)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:04.878683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccf87d-3bbd-4f86-93ee-2aba4ea172cc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:04.880322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 228/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/groups/6b8fa6d932544cfebf04f86c2070f829 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:04.886242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:04.984998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d037-ae65-464c-8953-8db5c81e664d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:05.004421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:05.019656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:05.020311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:05.020600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:05.020882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:05.021722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] RBAC: Adding query filter params (group.id=6b8fa6d932544cfebf04f86c2070f829, role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=e6f1e0d8c1cd468ea817eb192b478192) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:05.022038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:05.023510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e8057-d352-492f-a636-ba2254c203e0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:05.029544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 227/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue May 24 12:46:04 2022] GET /identity/v3/role_assignments?group.id=6b8fa6d932544cfebf04f86c2070f829&scope.project.id=e6f1e0d8c1cd468ea817eb192b478192&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:07.776741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4652f-0dae-48a8-89a5-0a0f5056f5cb None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:07.778141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4652f-0dae-48a8-89a5-0a0f5056f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:07.778706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4652f-0dae-48a8-89a5-0a0f5056f5cb None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:07.780274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 229/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:07.785837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:07.786285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:07.786611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:07.811189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:07.812486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:07.892317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159049-2015-4372-b5f2-d09f65239257 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:07.892639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159049-2015-4372-b5f2-d09f65239257 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:07.892871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159049-2015-4372-b5f2-d09f65239257 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:07.894561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 230/457] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:07.909205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec463-f958-4f2b-831d-9d5c925059a9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:07.909505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec463-f958-4f2b-831d-9d5c925059a9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:07.909769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec463-f958-4f2b-831d-9d5c925059a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:07.910494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 228/458] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:07.936560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:07.938053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-336ec463-f958-4f2b-831d-9d5c925059a9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:07.939424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-336ec463-f958-4f2b-831d-9d5c925059a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:07.980268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.051141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 231/459] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:08.052605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5869-c43c-483c-87b7-d6166dd15999 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.058523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5869-c43c-483c-87b7-d6166dd15999 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.059449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a5869-c43c-483c-87b7-d6166dd15999 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.061235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 232/460] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:08.074431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.074858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.075240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.080531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074197-a8c9-44e5-9a78-e25c1281ab0b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.096250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.099453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:08.100700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:08.122201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.123249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.123682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.124105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.136051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.138316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:08.158961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:08.160011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:08.160855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:08.160855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:08.160855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.160855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:08.163138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 229/461] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:08.164134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.190162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 233/462] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:08.190162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.276061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.291914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136938-53bb-471e-a207-7ae842d31fd9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.307989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1de3-534c-41ee-bc47-4adb53c48c1e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.328281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.329052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.329411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.329762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.330601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:08.330981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.332430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.347286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.348328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.348813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.349263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.355489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 234/463] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:08.357237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.362455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.364182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:08.384205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:08.385071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:08.385975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:08.385975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:08.385975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.385975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:08.388867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 230/464] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:08.389869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.410691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.467656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a7ec-4064-47bc-a044-59b0816bb5e7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.504478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.505525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.506020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.506351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.508631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806632-b08d-41fa-86e1-61573f20fbb2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.517145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.518641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.525635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:08.540860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:08.541904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 235/465] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:08.542839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.552080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.552767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.553053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.553332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.554055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.555527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd92ef-5778-4ace-8aad-1a05ac64bb0b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.577440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 231/466] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:08 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:08.583640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535d1f-20e9-490c-8bc9-38b02f1fe5df None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.583939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535d1f-20e9-490c-8bc9-38b02f1fe5df None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.584211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535d1f-20e9-490c-8bc9-38b02f1fe5df None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.585600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 232/467] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:08.591593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16535d1f-20e9-490c-8bc9-38b02f1fe5df None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.672681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed67f-3794-4d44-91c4-a21d3aafb2ca None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.687805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.718520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.719813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.720295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.720761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.720862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16535d1f-20e9-490c-8bc9-38b02f1fe5df None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.721804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:08.722373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.724174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d94a06-52fc-4175-a799-3f95cda11aba None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.739552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 236/468] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:08.741553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.742033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.742608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.760032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.760709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.760993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.761269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.762231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:08.762548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.763451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:08.763958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.765173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:08.778133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 233/469] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:08.779732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.838762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.860096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 237/470] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:08.860933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:08.906622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe1ae-2bb3-4847-bbe5-c8cdf8e2b495 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:08.950498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:08.951172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:08.951457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:08.951740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:08.952880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:08.954709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:08.963878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:08.980147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 234/471] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:08 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:08.981970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:09.046606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072ee69-e372-4799-8be9-c7b257dc6182 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.116354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.118526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.119907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.120384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.122696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:09.125343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:09.177238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 238/472] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:08 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:09.195425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081dc6e-4e7c-4907-91a4-659789c7f5b6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.240653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.241883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.242438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.242922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.260659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:09.262323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c6f96e78-5505-4b46-9e16-92fff7aaef42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:09.284427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:09.285309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:09.286161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:09.286161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:09.286161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:09.286161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.286161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 235/473] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:09.292101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:09.295848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9d60-18be-4d1e-8e71-ef41d324a61b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.296472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9d60-18be-4d1e-8e71-ef41d324a61b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.296750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9d60-18be-4d1e-8e71-ef41d324a61b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.299130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 236/474] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:09.304339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.304660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.304897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.323753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:09.325639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:09.352157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:09.384240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:09.435845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 237/475] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:09.440185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb092a-a8e6-4658-bbf8-39730d3b9a95 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.459304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:09.484853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.486272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.486826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.487411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.488546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:09.489016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:09.490942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:09.514191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 239/476] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:09.518230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:09.594409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7853574-2a4e-4c4c-9af4-37f3efd2fe68 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.664833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.665423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.665705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.665983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.666759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:09.668809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:09.685293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.sql.core [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 12:46:09.685293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 12:46:09.685293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [parameters: {'id': '5c43975ea2b64fcfae048b4276e594b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 12:46:09.685293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80162) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 12:46:09.700098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c973d-9ff3-4d66-9ec0-20f851aa80a8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.702642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 24 12:46:09.714201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return ref.to_dict() May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:46:09.715218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application yield resource May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.rollback() May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.force_reraise() May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise self.value May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application session.commit() May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 12:46:09.716702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._prepare_impl() May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.flush() May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._flush(objects) May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application compat.raise_( May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application flush_context.execute() May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rec.execute(self) May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 12:46:09.717810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:46:09.718661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:46:09.719460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [parameters: {'id': '5c43975ea2b64fcfae048b4276e594b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:09.720984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 12:46:09.722965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.731609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 238/477] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 24 12:46:09 2022] POST /identity/v3/roles => generated 144 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:09.731609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:09.772663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.774318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.774594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.774875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.775586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:09.777040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:09.807926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:09.826502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 240/478] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:09 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:46:09.897109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55119e8-3eb2-4661-9663-ae434663f4a2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:09.941503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:09.942289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:09.942561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:09.942837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:09.959948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c4e3ceae-8333-43a5-be2d-df6be6e82ff6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:09.968467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:09.971136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:09.973717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 239/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:09.981646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:10.106198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b33e-08ea-4a30-aa63-4bebf672b931 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:10.142961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:10.144000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:10.144502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:10.145018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:10.145971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:10.146518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:10.148148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f7518-cc49-423e-ba44-d1b7091c6d2d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:10.159119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 241/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:11.159650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185af57-df64-4952-acff-fc5f32769575 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:11.160167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185af57-df64-4952-acff-fc5f32769575 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:11.160242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185af57-df64-4952-acff-fc5f32769575 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:11.161830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 240/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:11.167578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:11.169025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:11.169509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:11.191369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:11.192878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:11.215545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:11.284953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 242/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:11.320669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185af57-df64-4952-acff-fc5f32769575 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:11.467346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:11.476015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185af57-df64-4952-acff-fc5f32769575 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:11.513358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:11.514186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:11.514475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:11.514752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:11.525709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:11.534642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:11.535657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:11.536425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 241/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:11.542234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:11.678642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb4968-d12f-4a5b-8d2d-bec5a4f4307e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:11.714573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:11.715898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:11.716144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:11.716427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:11.717188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:11.717551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:11.718921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:11.727540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 243/484] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:11.733298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:11.884063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4ecd5-d418-4ee8-ae7c-4ffc0796099e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:11.929351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:11.930562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:11.931042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:11.931549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:11.945427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:11.947297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1e8d0bd6-b8e3-4d8c-8584-a78e158b1228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:11.978827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:11.979681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:11.981791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:11.981791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:11.981791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:11.981791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:11.981791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 242/485] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:11.986392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.011081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.068749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac9d5-610c-4ba5-ba71-16881433a061 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.069043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac9d5-610c-4ba5-ba71-16881433a061 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.069311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac9d5-610c-4ba5-ba71-16881433a061 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.071309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 243/486] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:12.078255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6146-b2b2-4915-b32a-4d897dbaef95 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.078796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6146-b2b2-4915-b32a-4d897dbaef95 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.079275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6146-b2b2-4915-b32a-4d897dbaef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.111238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-579f6146-b2b2-4915-b32a-4d897dbaef95 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:12.112970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-579f6146-b2b2-4915-b32a-4d897dbaef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:12.116953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.118809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ff035-c258-4c77-bd3a-1cb921ffc2eb None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.173630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.175154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.175442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.175715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.176451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:12.176755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:12.178145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bf6c8-a848-4ab8-a099-cc1ec0926996 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:12.194594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 244/487] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:12.196075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434ceb-4be6-44b0-a62f-8476442e77f4 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.196363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434ceb-4be6-44b0-a62f-8476442e77f4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.196635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434ceb-4be6-44b0-a62f-8476442e77f4 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.198153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 245/488] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:12.203249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73434ceb-4be6-44b0-a62f-8476442e77f4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.215988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 244/489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:12.217486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.217778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.218063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.245001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:12.246695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:12.301747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.330710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73434ceb-4be6-44b0-a62f-8476442e77f4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.336194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 245/490] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:12.337059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.395435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.396399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.396801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.397178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.409903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:12.411600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:12.424440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:12.429737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:12.430863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:12.431829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:12.438434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 246/491] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:12.439433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.471265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953615d8-6e0e-4a3d-b774-19728df8b709 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.521171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.522060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.522457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.522804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.534687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:12.542916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:12.543783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 246/492] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:12.549746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.563479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c425ef-373e-48f0-b0e2-4d3ac22e5db3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.602646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.603818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.604358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.604848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.607534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.618228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:12.626534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:12.627397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:12.628167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:12.630885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 247/493] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:12.631931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.663907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816ac4-8605-44b8-8c53-abe87d7e4b57 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.699911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.710589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.711287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.711557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.711841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.712728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:12.713051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:12.714643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:12.758968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 247/494] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:12.759728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.762811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8884037-65a9-47db-924d-bebdea0b74cc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.799858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.800890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.801379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.801856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.802944 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:12.803453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:12.805030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:12.814034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 248/495] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:12.815325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.867880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e838-b798-4ce5-b71b-f4ecc8e62f65 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.876489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:12.905153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.905850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.906178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.906424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.907175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:12.907485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:12.908886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:12.917260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 248/496] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:12.918257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:12.924890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b44191-06c6-4c49-a551-6372c28b023e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:12.958733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:12.959379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:12.959672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:12.959956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:12.967162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.018179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b96-7c23-41f6-870e-dfbc0f8bcdb4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.029079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.030691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.050882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.051599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.051884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.052161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.063296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.064749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ce8b85bd-6ac0-4505-8f22-e08ee874ba3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:13.081616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.083884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.085036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:13.085036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:13.085036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.085036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:13.085036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 249/497] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.085289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0546-7e83-4e6e-b90a-60b35dd992a6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.085550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0546-7e83-4e6e-b90a-60b35dd992a6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.085714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0546-7e83-4e6e-b90a-60b35dd992a6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.087164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 250/498] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:13.088178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.088377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0c8-d0b0-4597-91e6-1f427ab9d436 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.088668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0c8-d0b0-4597-91e6-1f427ab9d436 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.088964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0c8-d0b0-4597-91e6-1f427ab9d436 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.090839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 251/499] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:13.094286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f0c8-d0b0-4597-91e6-1f427ab9d436 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.142612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 249/500] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:13.142612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.191004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.195781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f0c8-d0b0-4597-91e6-1f427ab9d436 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.228793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.229606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.229886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.230180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.239562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc96d1-019a-4a45-91b6-5d1d476c9dee None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.240714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.242221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-14c98ba4-e718-4f04-bd3b-2953f766efd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:13.259503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.260367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.261204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:13.261204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:13.261204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.261204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:13.261204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 252/501] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.262538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.262775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.263050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.278312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.278949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:13.279061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.279249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.279524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.280137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:13.280252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:13.280563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.281966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff3a3-7b9e-4ff2-933b-944182561a6d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.293250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 250/502] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:13.294479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.294775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.295055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.311222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:13.312378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:13.322942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.346327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 253/503] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:13.347176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.397065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 251/504] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:13.397996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.437003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.456069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127129-fa6c-4211-8da7-f08048ca2848 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.490345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.491144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.491426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.491699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.496786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c36f-4dc2-415b-beef-e6644c3a2337 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.502240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.503719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:13.522289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.523267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.524289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:13.524289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:13.524289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.524289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:13.528268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 254/505] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.529094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.531247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.531915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.532198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.532477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.533210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:13.533517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.534917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.547039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 252/506] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:13.547826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.558099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.630690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3ec6-efff-4c19-b093-50729d6cda41 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.650510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b47665-ab73-484f-9698-9f3e5b61e848 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.664241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.665109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.665403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.665676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.668259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.674864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.676413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.685482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.686312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.686599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.686875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:13.693025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.694059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 255/507] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.699626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.704813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.706323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:13.723935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.724929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.725816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:13.725816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:13.725816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:13.725816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:13.725816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 253/508] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.726205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.785778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.801375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a138-5d87-41fd-8f4e-bbf0b5e6c944 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.827460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9de7cd-b54d-4420-a572-33f4d73dc088 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.834206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.834998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.835279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.835568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.846418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:13.854268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:13.855875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:13.856797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 256/509] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:13.857540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.866413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.867079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.867365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.867644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.868365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:13.868673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:13.870038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:13.881806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 254/510] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:13.882885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:13.913373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:13.959105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80a713-d3d1-4918-b6ea-1801d714e8d6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.980492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c040-fcba-4007-8615-97c957f8fcc9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:13.992300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:13.993084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:13.993377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:13.993650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] PATH_INFO: `/v3/users/glance` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:13.999137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.001722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.003230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.016071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.016732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.017014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.017286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:14.017826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:14.018887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:14.024556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:14.025164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:14.025164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.025308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 257/511] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:14.025384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.025460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.056821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 255/512] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:14.057645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.120345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e768a-7ff3-49cc-810c-295079588eda None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.134606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.157355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.157642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eecf0-3b47-4c79-907b-64ab409b8f62 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.158014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.158335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.158615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.159343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:14.159650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.161057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.172828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 258/513] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:14.173624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.191887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.192557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.192839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.193117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.193867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:14.194206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.195594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.204086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 256/514] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:14.204870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.245903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.278764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28849a23-2e3c-44ca-ad13-33b40ec88d3f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.307483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356888-f0c5-4608-84fb-090ea7897e16 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.311645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.312430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.312713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.312982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.319684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.321150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:14.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:14.337108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:14.338140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 259/515] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:14.339111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.343186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.344648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.344938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.345219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.346144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:14.346463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.347884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.366272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 257/516] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:14.367036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.378438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.446546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552cd5-6f15-4006-8948-0d53c7150ec0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.461623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.468025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607ce9a-dd61-4fc5-9e19-2b076ac62427 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.481283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.482021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.482331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.482605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.501470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.502152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.502439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.502713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.503408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.504855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.524711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 258/517] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:14 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:14.525513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.556992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.559250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.597321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.652794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430263-a5f2-4555-91d1-e0acbb439b5b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.687384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 260/518] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:14.688181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.699053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.701461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.701746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.702023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.714613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.716734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:14.736598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:14.737456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:14.738294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:14.738294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:14.738294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:14.738294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:14.738294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 259/519] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:14.738609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.742892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.812528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a112d8-c4cd-4f4f-9543-86a88a2ac94e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.849131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.849837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.850153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.850431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.851225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:14.851532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.852998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.853781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c271f8-00fc-45ec-bf43-f95a0745ac4f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:14.854895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.878006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 261/520] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:14.878006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:14.894406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:14.895170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:14.895553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:14.895912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:14.970060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:14.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:14.974333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:14.985221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bab65-9632-40f0-9e15-7f79bada3f4e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.021048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.021846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.022154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.022439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.035110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.036605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:15.054514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:15.055561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:15.056577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:15.056577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:15.056577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:15.056577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:15.062631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 262/521] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:15.062631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.095423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 260/522] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:15.096497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.115737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.175747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29145f-e7b5-4174-b2d5-8db90f2aec85 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.211582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.212242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.212535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.212799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.213518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.213824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.215770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.216895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e17e-b2f7-4d73-aad0-464a1b608d68 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.220270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.232895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 263/523] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.232895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.259530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.260283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.260570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.260843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.261804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.262138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.263692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.269852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 261/524] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.275128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.344688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa010c09-a175-49ee-9392-ab39b04600b5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.353006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.388135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.388867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.389162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.389441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.390217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.390532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.391964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.405689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 264/525] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.408228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87400d-0299-47a1-a624-89a98a73d0f7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.409521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.450647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.451967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.452473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.452964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.465289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.467302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:15.488556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:15.489400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:15.490260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:15.490260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:15.490260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:15.490260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:15.492744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 262/526] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:15.493821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.518942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.526339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980f1d-5a42-42c6-bcde-d85de4571a2d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.568601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.569403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.569686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.569962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.580222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.582133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:15.600037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:15.601049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:15.601918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:15.603005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 265/527] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:15.603071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.615027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d384c-3006-4581-8be0-0acd97b44ff6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.647481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.658769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.659916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.660409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.660873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.669934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.671901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:15.689665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:15.690569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:15.691415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:15.693899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 263/528] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:15.695203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.741376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896526-5293-475d-ad5a-e2d86f414834 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.780482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.781252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.781558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.781918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.782684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.782991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.784397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.794491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.799448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 266/529] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.800520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.815352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253294-2158-4b75-9d78-0bf6835e3e9e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.851792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.852569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.852841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.853123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.854095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.854409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.856471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.879863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 264/530] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.879863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.900845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:15.917514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd504-c24e-4b73-abc8-73ad471a706c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:15.954261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:15.955161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:15.955588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:15.956002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:15.956965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:15.957417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:15.959144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:15.977306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 267/531] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:15.978531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:15.985008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a767b84-87e4-4e22-a2f9-53ebce97e272 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.023463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.024179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.024464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.024738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.032278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.033851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.035860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:16.052936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:16.054009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:16.054965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 265/532] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:16.055434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.090685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab670d-c80e-4049-9501-66a996ce1c85 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.127012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.127903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.128360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.128774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.146222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:16.184736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce87b3-5761-4c11-a9cf-0e9d07d1ed73 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.203712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.205402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.219967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.220631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.220920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.221203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.222328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=68d8d9ddbe0c4ebb920c126f0122ce33) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:16.222445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.223788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.238149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 266/533] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/role_assignments?user.id=68d8d9ddbe0c4ebb920c126f0122ce33&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:16.238149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.301787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:16.347493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847050-cb41-4826-b5e7-e4e9cbaa8dc6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.388077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.388755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.389043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.389319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.390286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:16.390599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.392305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.418544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 267/534] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:16.424266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.435290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 268/535] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:16.442166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.513782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:16.587072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed3925-fac1-47b4-bcbb-420df2a25534 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.614167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6559f-a6ce-4381-894a-4d9a236ac6de None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.614447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:16.625503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.626194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.626543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.626822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.627718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=c58212e67bed45fc9c573568eea16b14) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:16.628038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.629494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.639213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 268/536] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/role_assignments?user.id=c58212e67bed45fc9c573568eea16b14&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:16.682787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.682787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.682787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.682787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.696582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.698101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:16.726066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:16.727060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:16.727885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:16.727885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:16.727885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:16.727885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:16.735336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.736439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 269/537] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:16.877569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3cf8-ce41-461f-a866-bd9dd1a8bed9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:16.913120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:16.913787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.914070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.914418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.915149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:16.915459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:16.916846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bfc3e-c717-435e-9e86-be5c46219828 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:16.929899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 269/538] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:16.936333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:16.970170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8e08-1b6e-4ca6-90b8-b1faf8ad7e14 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.970505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8e08-1b6e-4ca6-90b8-b1faf8ad7e14 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.970786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f8e08-1b6e-4ca6-90b8-b1faf8ad7e14 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.972188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 270/539] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:16.978244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:16.978669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:16.979051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:16.997164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:16.998296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:17.061151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:17.064215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:17.069359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daaf8e-dea2-4b21-b3e8-cbabfa425e4e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.114434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 271/540] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:17.133016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.134034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.134579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.135070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.139947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.147128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:17.148877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:17.170355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:17.171428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:17.172441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 270/541] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:17.177788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.279102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e95d79-4f3a-487a-812d-03f85d87ed7d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.323706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.324543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.324820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.325098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.361244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:17.378183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:17.379112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:17.379959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:17.380543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f32d9-514d-49dc-9faa-1730aee35ec9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.383344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 272/542] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:17.390028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.415296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.416287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.416794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.417286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.418873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:17.421963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:17.423700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:17.458913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 271/543] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:17.460565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.474511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:17.523194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:17.540421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f9f1-0300-4b02-a495-b8bae998a532 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.577479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.578536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.579453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.579937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.580886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:17.581394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:17.583135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:17.592552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 273/544] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:17.597730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.710667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d38a-7eaa-44d5-a23b-d36772e386d7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.715182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:17.768183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75add16d-2252-46aa-879b-a791fff99b86 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:17.807438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.807689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:17.808911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.809286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.809569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.809860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.810461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.810944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.812106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=4c9d6becc7f8440e88cc2a3a043ac824) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:17.812655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:17.814505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:17.821858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 272/545] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/role_assignments?user.id=4c9d6becc7f8440e88cc2a3a043ac824&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:17.840672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:17.842232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-968f4fd1-48dc-4129-a7d1-6de675162ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:17.874434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:17.875350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:17.876162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:17.876162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:17.876162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:17.876162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:17.876162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 274/546] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:17.882053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:17.949574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ecb7-384b-4320-99b4-c386e4d48166 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.949899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ecb7-384b-4320-99b4-c386e4d48166 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.950198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ecb7-384b-4320-99b4-c386e4d48166 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.951713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 275/547] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:17.959398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:17.959679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:17.959958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:17.993539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:17.994718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:18.019833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:18.058240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac62c7-5d97-452e-b686-3e5ffe4bc375 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.100729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.101394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.101684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.101973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.102597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 276/548] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:18.102786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:18.106262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.106262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.118269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 273/549] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:18.123795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.131342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.215626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:18.236933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78063db3-9bff-4dbc-8610-6360b2c88cc2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.273170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.274320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.274826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.275297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.283554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.285357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:18.301928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:18.303406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:18.304458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:18.307177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 277/550] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:18.313294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.389390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3d35-8fbf-4488-86e0-576879576d65 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.429309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.430142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.430423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.430698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.443336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:18.451677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:18.452602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:18.453563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 274/551] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:18.458856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.462305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:18.571336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24fd3b-df95-47ed-8d0d-bdcee2f90f3b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.606852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41f31-71ea-4119-86cc-12aedf3770d3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.607766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.608673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.608968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.609244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.610003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:18.610345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.611748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.621703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 275/552] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:18.627693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.704604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:18.738858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6f94-23dd-4810-a5cb-0d7b1791cc33 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.754846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.755577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.755860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.756135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.757251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:18.757557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.759025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.775748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.776553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.776840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.777714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.786170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:18.790395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.792466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.804544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 278/553] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:18.810764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:18.811816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:18.812719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:18.814507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:18.814507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:18.814507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:18.814507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:18.814507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 276/554] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:18.819675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:18.938394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ed04-1959-4636-8a96-6f1a7200fb18 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:18.976824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:18.977981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:18.978301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:18.978582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:18.979314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:18.979624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:18.981081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:18.994246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 277/555] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:18.998610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.001087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.122919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05ce33-35c7-42de-a75d-4796456a3a48 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.123403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fc78-8a1a-445a-a7c0-57307b9e4e82 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.170102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.170788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.171075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.171354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.174279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.175930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.176216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.176490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.184687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:19.186185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-afd1cb53-8ef7-4f16-8e6b-7bc5568a412f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:19.201090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:19.202005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 278/556] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c35ba-825b-48bb-bc9e-386ba66e5c18 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.207830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c35ba-825b-48bb-bc9e-386ba66e5c18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.208527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c35ba-825b-48bb-bc9e-386ba66e5c18 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.208527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 279/557] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:19.210540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5c84-e270-403e-b29a-504a0f4b410a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.210833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5c84-e270-403e-b29a-504a0f4b410a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.211114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5c84-e270-403e-b29a-504a0f4b410a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.213956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 280/558] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:19.213956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5c84-e270-403e-b29a-504a0f4b410a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.248481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.253220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:19.254800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebdc4e-e0ec-45bb-9f28-a1cd67e32d78 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:19.254921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.328736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5c84-e270-403e-b29a-504a0f4b410a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.364813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 279/559] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:19.364813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.364813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.364813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.370564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.371337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.371623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.371900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.372744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:19.373148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:19.374646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b51bb6-3d29-4e67-9b57-b72a4a5909be None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:19.382050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:19.383296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:19.395951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 281/560] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:19.397226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafdd7-1534-441d-b591-83960af33feb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.397517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafdd7-1534-441d-b591-83960af33feb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.397792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aafdd7-1534-441d-b591-83960af33feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.420219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-44aafdd7-1534-441d-b591-83960af33feb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:19.421415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-44aafdd7-1534-441d-b591-83960af33feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:19.460054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 280/561] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:19.460844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.498142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.505036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 282/562] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:19.505877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aafdd7-1534-441d-b591-83960af33feb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.532842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.589514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cf95e-6b2a-4e33-bc34-faf243b9d01e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.613926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aafdd7-1534-441d-b591-83960af33feb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.626510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.628286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.628569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.628842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.639621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:19.641079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:19.651603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.652726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.653076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.653429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:19.659061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:19.659921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:19.660864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:19.660864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:19.660864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:19.660864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:19.660864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 281/563] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:19.661128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.668892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:19.670393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:19.688623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:19.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:19.690438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:19.690438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:19.690438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:19.690438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:19.694360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 283/564] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:19.695061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.760545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.783564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96493a-ae48-40fc-8dab-e78f05727579 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.820044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:19.823249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.824783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.825044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.825390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.838622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:19.846254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a14e89-355b-4136-b68a-65c519c37ca3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:19.848279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:19.849372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:19.850421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:19.854253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 282/565] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:19.855534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.893019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:19.893931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:19.894328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:19.894660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:19.906465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:19.914445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:19.915408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:19.916256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:19.921844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 284/566] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:19.922828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:19.973572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b06b6-d975-42ca-ab45-5894315f6bf9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.016300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.016887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.017172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.017457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.018689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.019742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.021122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.030574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.039064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 283/567] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.040135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.041760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082bd1-3ac3-402b-b0cc-d32a8321b8cb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.083920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.085781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.086233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.086619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.087504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.087947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.089624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.093410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.112087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 285/568] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.113071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.184753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682928-ef17-45fe-a5fa-3730ee306ab4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.232301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.233294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.233582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.233862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.234655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.234966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.235065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edffa4c-42ae-40cb-b51f-d02c3fd0cc98 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.236336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.250487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 284/569] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.250487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.276171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.276765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.277073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.277347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.278260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.278597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.279987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.288034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 286/570] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.288819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.316070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.348384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.355806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0064f-9a92-4b09-865a-6dcdfb744fe7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.389712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.390536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.390818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.391092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.392323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff007-3573-4e2a-9f0c-b13bb836419b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.397654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.399134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:20.413138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:20.414022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:20.414927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 285/571] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:20.415467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.431507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.432299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.432585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.432865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.440305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.441769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-087648c0-df8f-46f8-ae04-aab6e20cdb45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:20.456150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:20.457216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:20.458079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 287/572] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:20.458794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739792d-e222-4bdc-8478-facdfe1eb318 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.458878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739792d-e222-4bdc-8478-facdfe1eb318 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.459090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739792d-e222-4bdc-8478-facdfe1eb318 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.460416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 288/573] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:20.461113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739792d-e222-4bdc-8478-facdfe1eb318 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.522369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc781bb-55e9-4e27-b52e-5f6db9dd72d4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.544668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.556398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.557181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.557459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.557730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.562872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739792d-e222-4bdc-8478-facdfe1eb318 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.568552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.569973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.581374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:20.588321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:20.589161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:20.590591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:20.590591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:20.590591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:20.590591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:20.590591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 286/574] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:20.591069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.602893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.603686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.603967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.604241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.614371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.615856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:20.633935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:20.634854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:20.635707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:20.635707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:20.635707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:20.635707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:20.635707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 289/575] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:20.636009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.694685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798397-a024-458e-adcc-5d96f1c89a5a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.728671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.729557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.730658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.730948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.731745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.732064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.733495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422eb36-af34-48ea-a181-1694c4bb5424 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.735500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c6700-c2bf-42ff-81ef-2e878e618d2f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.744850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 287/576] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.746051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.746433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.746720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.765895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:20.767153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:20.770366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.771032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.771318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.771598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.772384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.772696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.774215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.790806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 290/577] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.792136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.802358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.831276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:20.848310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 288/578] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:20.849155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.907744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469eb2-5244-4497-b4b6-9099663dbfd3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.940727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.941379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.941659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.941940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.942931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.943047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.944349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:20.957207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 291/579] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:20.957603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108bffc-1391-4a09-830a-c15f9a500534 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:20.957988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:20.992456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:20.993117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:20.993396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:20.993676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:20.994436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:20.994743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:20.996355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.007607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 289/580] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:21.008367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.033546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.048903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.059497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d967a67-f93f-4313-8960-1003e141f5ed None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.094936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.095592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.095874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.096149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.096975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=2871bcf4578040648c19fb6eb9464261) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:21.097288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.098760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.104389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 292/581] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:20 2022] GET /identity/v3/role_assignments?user.id=2871bcf4578040648c19fb6eb9464261&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:21.105199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.122689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791200b-948c-4221-9601-28f987fedf50 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.164255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.165345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.165634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.165913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.182590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=0532ebb4e77b41179663accaa80e4942, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.184928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.200409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 290/582] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:21 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:21.201032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.236408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f53b-f944-4182-8d1d-3b115c979945 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.295615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.296615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.298730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.299350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.300667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.322934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:21.331029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20477-e50d-4d46-92bd-18a558d19b51 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:21.333484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:21.334413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:21.335243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:21.338297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 293/583] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:21.340030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.366483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.383006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.384207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.384707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.385186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.395259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.397031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:21.414175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:21.415070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:21.415998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 291/584] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:21.416572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.483465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337ee0-ec35-4cbf-a216-43c31d66de27 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.525371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.526598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.527681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.528200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.537140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.539174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.541506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f4bd-5e9c-438c-8271-d6d3e24f8527 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:21.557143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:21.558214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:21.559174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:21.562897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 294/585] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:21.564426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.584456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.585317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.585450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.585641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.586453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:21.586790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.588134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.589627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.597617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 292/586] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:21.598806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.663657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.704046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b0dd-24c5-429c-9ea3-9dc006311d33 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.719972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e176b-fa80-472e-9474-d77c039eadec None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.753515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.754612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.755134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.755612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.755992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.756654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.757201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.757477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.757926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:21.758341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:21.758654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.758894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.760091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.760878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.778722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 293/587] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:21.783058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.785041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 295/588] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:21.786176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.847214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.896063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb57ab-a893-414d-b64c-56fe8d0f8047 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.930206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5222613-9cce-4252-8820-c059719c9ef5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:21.933694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.934529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.934921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.935271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.946279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:21.947868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:21.969621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:21.970595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:21.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:21.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:21.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:21.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:21.971480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 294/589] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:21.972553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:21.972971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:21.981076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:21.982168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:21.982635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:21.983111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:21.998857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.001129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:22.026438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:22.028015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:22.028870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:22.028870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:22.028870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:22.028870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:22.031417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 296/590] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:22.032359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.088711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a802-9fde-433e-8234-c1abd73e2f9c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.098491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.128588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.137485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.137485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.137485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.147628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.149350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:22.169355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:22.170325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:22.171244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:22.171244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:22.171244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:22.171244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:22.173135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410a9dc-c951-4a7a-8889-f82598fe772f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.173610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 295/591] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:22.174846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.220219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.221305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.221597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.221880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.222927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:22.223246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.224909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.240993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 297/592] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:22.241622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.286836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaa71-a8d4-4292-b30c-523f890d3973 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.310767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.325886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.326964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.327473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.327973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.329008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:22.329554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.331255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.349328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 296/593] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:22.350804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.378746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.380230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac04ec-3eb7-4174-b502-c0a1f6fdfdad None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.426654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.427332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.427618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.427896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.428644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:22.429384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.431105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.446956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 298/594] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:22.447984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.484290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189635-b948-47e4-ab61-26c3a50094a7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.525428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.526715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.527763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.528399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.536805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.538642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:22.557441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:22.559937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:22.560857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:22.563786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 297/595] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:22.564895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.565071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add41e6-659b-4059-9547-6e8aac720f38 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.567435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.613782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.614528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.614812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.615091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.623486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.625334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:22.645290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:22.646218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:22.647488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:22.650179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 299/596] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:22.651322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.669881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.695817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50135a-d799-4623-a39d-0fcd13e8a15a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.734733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.736385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.736873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.737348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.745076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.747574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:22.764515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:22.765405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:22.766396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:22.769189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 298/597] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:22.770474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.778430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b649868-fd9f-40f9-a470-a1c92830945d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.822577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.823267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.823605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.823938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.824744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:22.825058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.827098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.854071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 300/598] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:22.854071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:22.882309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.897542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b793e-4771-4ad1-b742-3cdd5f28a35c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.945566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:22.946747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:22.947451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:22.948389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:22.950812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:22.951594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:22.953641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:22.964109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:22.969991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b817e0-2f5a-4109-9dc2-9bbaf20e4044 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:22.974700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 299/599] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:22.975818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.022932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.023657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.023944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.024260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.025161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:23.025507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.029214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.044612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 301/600] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:23.046710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.115540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53423c7-0483-4aaf-bf15-0dcfc44f4b84 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.146541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.155720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.156828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.157314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.157846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.169196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e54bd-11f2-466e-98ff-d3d91670f824 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.171471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.173283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:23.192283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:23.193252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:23.194188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:23.194188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:23.194188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:23.194188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:23.196370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 300/601] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:23.197370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.210341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.211707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.211855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.212237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/68d8d9ddbe0c4ebb920c126f0122ce33/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.231249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=68d8d9ddbe0c4ebb920c126f0122ce33, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.232520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.258135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 302/602] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:23 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/68d8d9ddbe0c4ebb920c126f0122ce33/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:23.258135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.284608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.411479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12427834-9b5d-47b5-bc0f-1cee4fcdfb30 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.453848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.454796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.455084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.455355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/c58212e67bed45fc9c573568eea16b14/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.464925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2157a4-f862-4dfd-b5f2-3eda8b492695 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.472458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=c58212e67bed45fc9c573568eea16b14, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.474844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0fe4-cc7c-43c0-aa80-d45a2f1dac91 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.494777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 301/603] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:23 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/c58212e67bed45fc9c573568eea16b14/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:23.497830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd70c8-aa69-4d56-bab7-1578c28c475b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.498295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd70c8-aa69-4d56-bab7-1578c28c475b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.498625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd70c8-aa69-4d56-bab7-1578c28c475b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.500042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 302/604] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:23.501712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.502154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238a2c-72b3-4dd3-bc8c-7d4661ac3468 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.503626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238a2c-72b3-4dd3-bc8c-7d4661ac3468 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.503626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238a2c-72b3-4dd3-bc8c-7d4661ac3468 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.504828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 303/605] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:23.507284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.507698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.507990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.513093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.514465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.515171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.515534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.517445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:23.517445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.520748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839de5ea-6fb9-4f6b-9d9d-8f54731bb873 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.529304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:23.530951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:23.536060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 303/606] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:23.537818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.538350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.538853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.567049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:23.569873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:23.617509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 304/607] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:23.618788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.657493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.665067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 304/608] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:23.666390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.767651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9baf-b64e-4b7b-a99a-0a1a584bfd4e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.800675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ba84d-f9ba-459d-b1a2-a1f557c22ba0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:23.816847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.818228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.818980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.819454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.825971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.832275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:23.835087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:23.839051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:23.840158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:23.840452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:23.840824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:23.852434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:23.853076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:23.853925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:23.855449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:23.858155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 305/609] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:23.859182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:23.866698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:23.867747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:23.868577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 305/610] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:23.869310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:23.969275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:23.981253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3933f-bb62-4601-ad53-d6b32f36e786 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.006252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54318-76f3-482b-8455-47180ebfb086 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.024475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.025987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.026484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.027108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.042186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:24.044470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.045296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.045677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.046082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.047000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:24.047468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.049115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:24.053159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:24.054310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:24.055224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:24.063083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 306/611] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:24.063083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.070984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 306/612] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:24.072157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.131069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.188185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779377d-9673-478e-bd30-028a3cc5e493 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.215676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43276c7-0230-42dd-877a-2f3e26a2f4f8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.227339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.227938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.228215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.228485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.229233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:24.229532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.231706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.240560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 307/613] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:24.241441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.258004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.266912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.268380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.269248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.269796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.270935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:24.271765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.273810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.291291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 307/614] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:24.291291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.374682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10ff5a-51d4-4a13-bde3-2fb1a935791e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.413680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae42dd-eaf9-4ec6-bc1c-949d4ae77410 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.416729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.421348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.423500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.424012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.425216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/4c9d6becc7f8440e88cc2a3a043ac824/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.444224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=4c9d6becc7f8440e88cc2a3a043ac824, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.445658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.460047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.461215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.461744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.462258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.466357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 308/615] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:24 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/4c9d6becc7f8440e88cc2a3a043ac824/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:24.468811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.488117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.490417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:24.525695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:24.527324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:24.528209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:24.528209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:24.528209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:24.528209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:24.530392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 308/616] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:24.537772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.606633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.689957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c81-f93c-420e-8d6f-07756d65878d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.738976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549f66-ac91-4106-a5d5-6f65c0dfde75 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.751908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.752820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.753110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.753387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.775546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.777249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.795242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.795926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.796209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.796486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.797220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:24.797527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.798973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.811505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 309/617] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:24.814622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:24.815489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:24.816351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:24.816351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:24.816351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:24.816351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:24.816351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 309/618] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:24.817034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.821535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:24.844701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.930141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319ebf-e032-452d-86c3-2f7562491a01 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.945274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:24.979285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:24.980012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:24.980299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:24.980636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:24.981371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:24.981725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:24.983133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:24.984825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec550a-87b3-4744-ae04-85fb4ec67d6b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:24.996012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 310/619] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:25.001110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.054803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.055606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.055885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.056159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.066573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.068051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:25.096699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:25.097705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:25.098680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 310/620] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:25.103586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.141135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb749d8-8030-4e53-9acc-7428dea5442f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.209754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.210980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.211498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.212012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.222463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.224226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:25.247503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:25.248453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:25.249363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:25.254577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:25.258180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 311/621] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:25.263758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.303901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81c921-3d13-49f1-80a1-02545981675f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.329125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:25.372484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.374386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.375549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.376209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.378354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:25.379080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.381826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.418941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 311/622] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:25.426374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.460799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a1c4-9848-4609-8443-c10b9482293b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.525871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.526494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.526894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.526894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.528129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:25.528442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.529874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.569870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 312/623] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:25.581688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.610064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f878-5ea5-4fab-9c1c-f2ff25a3d331 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.661272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.662074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.662383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.662657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.668097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:25.688874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.690414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:25.724459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:25.726578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:25.728620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:25.728620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:25.728620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:25.728620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:25.730272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 312/624] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:25.732826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:25.775209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:25.791357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2689f2-54af-4ec8-9bc0-20456aa5f98e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.854704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.856241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.856443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.856594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.933775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.935576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f6217-1f10-45a2-8f11-f195228bcc95 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:25.952863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ebcf-17b3-484e-9dcb-d3af0f120c48 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:25.991342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:25.992010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:25.992294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:25.992572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:25.993298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:25.993607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:25.995024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07920-7f72-43f4-876b-dbe12acdcbd7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.008193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 313/625] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:26.009346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afebc1-838e-4902-8ef3-08bb697ae44c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.009638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afebc1-838e-4902-8ef3-08bb697ae44c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.009918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afebc1-838e-4902-8ef3-08bb697ae44c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.014156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 314/626] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:26.014156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c15f-35e8-4f6e-a599-34d66775eec6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.014156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c15f-35e8-4f6e-a599-34d66775eec6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.014156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026c15f-35e8-4f6e-a599-34d66775eec6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.018252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 315/627] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:26.019189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026c15f-35e8-4f6e-a599-34d66775eec6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.041697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.055547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 313/628] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:46:26.055547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a34b-6e24-40e3-8864-0611387d24cf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.055547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a34b-6e24-40e3-8864-0611387d24cf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.055547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a34b-6e24-40e3-8864-0611387d24cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.070607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-54b8a34b-6e24-40e3-8864-0611387d24cf None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:26.071789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-54b8a34b-6e24-40e3-8864-0611387d24cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:26.079025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.139266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026c15f-35e8-4f6e-a599-34d66775eec6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.150151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 314/629] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:26.150151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.150151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.150151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.172848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:26.174171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:26.186310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.187171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.187455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.187754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.195036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.196496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:26.210885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:26.211801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:26.212662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 316/630] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:26.213145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.254154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 315/631] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:26.254154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.309337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.326522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bf4b-7352-4502-a1a0-aadf7da8d8f6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.335347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.361821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb41d2-b856-4aaa-8906-ea3a76adeb2c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.366418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.367215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.367501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.367778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.380910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.382686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.399003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.399800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.400084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.400360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:26.403003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:26.403856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:26.404728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:26.404728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:26.404728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:26.404728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:26.408751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 317/632] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:26.409631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.418709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:26.427123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:26.428021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:26.428839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 316/633] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:26.430596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.522261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134549-32ec-41c6-8e99-39dfbbf89679 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.540044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8e62-81d7-41e8-96a6-90d25ff1363e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.554904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.557123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.558386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.558696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.558968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.559811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:26.560070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.561515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.573026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 318/634] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:26.573910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.585258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.586551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.587054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.587680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.595082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.600529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:26.608851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:26.610003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:26.611072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:26.615443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 317/635] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:26.616296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.680820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90daf86-5665-4de8-8d97-343dfd01742b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.719027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.719713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.720001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.720282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.720819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199d69-7194-4e1c-946e-b8d46d03fa67 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.721192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:26.728246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.728246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.744918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 319/636] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:26.744918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.769676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.770406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.770783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.770992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.771698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:26.772003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.773458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.781584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 318/637] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:26.782408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.820145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.836450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:26.861305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3625c3-bdbd-46cc-8558-7718c5d247b2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.888508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d57ee-2aed-4330-9068-60253bd33e1d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:26.899380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.900278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.900563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.900842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/2871bcf4578040648c19fb6eb9464261/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.915354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=2871bcf4578040648c19fb6eb9464261, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.916807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.922673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:26.923576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:26.923869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:26.924150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:26.925013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:26.925446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:26.926818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:26.929797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 320/638] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:26 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/2871bcf4578040648c19fb6eb9464261/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:26.930645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:26.940556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 319/639] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:26.940556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.050529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.054157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb56354-30ef-4464-adef-545034fa238b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.057880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd9576-35c8-41fd-8b4e-2b67bd0f2123 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.085467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.095883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.097229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.097518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.097797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.099352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.100259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.100606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.100957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.106605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.108376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.113547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.115027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2c25c889-df41-417a-9ac8-337e8cbd7c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:27.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:27.127885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 321/640] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8256d-b8b3-44e3-846d-c388e221f9bc None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.129894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8256d-b8b3-44e3-846d-c388e221f9bc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.131258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8256d-b8b3-44e3-846d-c388e221f9bc None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.135521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 322/641] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:27.135521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8256d-b8b3-44e3-846d-c388e221f9bc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:27.137446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:27.139053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:27.139940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:27.139940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:27.139940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:27.139940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:27.139940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 320/642] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:27.141212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.247112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8256d-b8b3-44e3-846d-c388e221f9bc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.251061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c2a2-50e1-44ea-b2a4-c5242a3f329e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.283093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.283896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.284183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.284463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.289027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.289862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.290311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.290743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.291706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:27.292017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.293571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223215af-07b7-4032-aa98-37626b153d38 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.296147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.297612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.306481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 321/643] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:27.308481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.308768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.309045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:27.322808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:27.324374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:27.325408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:27.325408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:27.325408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:27.325408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:27.331690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 323/644] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:27.331690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.331914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:27.331914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:27.333868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.381149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.414433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 322/645] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:27.416746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.448276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199a04-3cf7-4439-ae31-14b0aa9153d5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.488939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.489716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.490003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.490311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.491163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:27.491478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.492854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.507844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 324/646] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:27.508692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.532798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aee18-9ffe-4995-8641-bcb9bc156449 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.574003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.574688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.574971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.575403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.576710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:27.577030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.578904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.594156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 323/647] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:27.594156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.597615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.610993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.614646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fde4-4ab5-4b81-9ea6-868a62827a89 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.655571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.656627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.656984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.657329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.658758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:27.659076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.660760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.678259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 325/648] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:27.679365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.740733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969de3-7d50-4beb-8a24-9c7dcff4e20a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.779173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.779988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.780272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.780547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.793400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:27.804104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:27.805221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:27.806223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 324/649] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:27.806941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.812589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21862d2-5f7c-484e-abe2-b3c44e435e96 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.853204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.854396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.854991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.855692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.863801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.865453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:27.877916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:27.883874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:27.884829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 326/650] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:27.891024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:27.914724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:27.931631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f5cbe-a450-4a49-9bc9-0efbe36410b2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:27.980130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:27.981679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:27.982070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:27.982471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:27.993371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:27.994961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.009572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f63a-dba3-403c-86de-9d306ae53364 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:28.015999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:28.016955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:28.018048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 325/651] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:28.022715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.064634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.065306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.065585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.065861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.066740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:28.067052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.068538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.078957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 327/652] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:28.079868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.147636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325845b4-bf1a-460f-bba3-ab949bb5b905 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.171812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.187823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.188760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.189184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.189593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.190604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:28.191069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.191278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.192914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.211477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d147fc-567a-4267-898d-4d74ca1c6d83 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.212235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 326/653] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:28.213252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.253272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.254962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.255543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.256088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.257604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:28.258482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.260648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.284573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 328/654] 10.222.0.36 () {56 vars in 1137 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:28.286286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.356184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1b9bd-efed-4237-bd52-65d8db2b6262 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.408464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.410138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.410576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.410982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.418909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85dc0-ac29-4376-908c-e14dc71531e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.425276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.426984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:28.445390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:28.446626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:28.447485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:28.447485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:28.447485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:28.447485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:28.450268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 327/655] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:28.451254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.463171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.464151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.464788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.465283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.477002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.494313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.554728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.556878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.572614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621fa61-5302-4fe1-a57a-36924c295191 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.615051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.616049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.616527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.616993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.690987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.692840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.692949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 329/656] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:28.693775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.730438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.763039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.823514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 328/657] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:28.825092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.836515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60d0d9-2e8b-4277-89f0-b464253305a4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.870294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.871532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.871930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.873214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.873437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:28.873841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:28.875412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:28.889261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 330/658] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:28.890468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:28.945751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadede-3d43-47d9-ba37-1f08ad49df58 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:28.980281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:28.986078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:28.987102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:28.987555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:28.987972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:28.999724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.001234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.003123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.003663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b06b46-6eb2-4747-b98f-b7800f10d315 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:29.023725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:29.024679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:29.025548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:29.025548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:29.025548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:29.025548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:29.033065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 329/659] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:29.034593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.044233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.045365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.045735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.046186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.060177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.061966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:29.081116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:29.082475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:29.083688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:29.083688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:29.083688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:29.083688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:29.083688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 331/660] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:29.083975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.148919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5eee2-214f-4751-87bb-6672ba0b253d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.185976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.187050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.187507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.187936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.196077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.197670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.198147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025342d-a390-44a7-bc57-206aa58cabb4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:29.216290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:29.217447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 12:46:29.218585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:29.220988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 330/661] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:29.222030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.239565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.240231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.240510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.240782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.241494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:29.241799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.243220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.255885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 332/662] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:29.257239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.273716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.276061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.333381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3dc2d-0af5-4f77-bcc3-19d318f2d603 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.367744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.368289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e21192-3638-4f1a-bb07-7faa9e8c8de3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.368430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.368666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.368990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.369708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:29.370033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.371524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04e9e-2a10-46f7-998a-df245688e0e0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.383386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 331/663] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:29.384696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f352d-e5f4-49ce-9851-f0c89ea18414 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.384982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f352d-e5f4-49ce-9851-f0c89ea18414 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.385256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f352d-e5f4-49ce-9851-f0c89ea18414 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.390157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 332/664] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:29.390157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f352d-e5f4-49ce-9851-f0c89ea18414 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.419428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.421317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.422053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.423367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:29.423869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.425476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.446900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 333/665] 10.222.0.36 () {56 vars in 1139 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:29.447845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.513901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f352d-e5f4-49ce-9851-f0c89ea18414 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.516453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.523194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.552625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.553577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.553857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.554141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.559067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876381fb-41e1-4158-be3c-5472e30b5b6a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.563044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.564482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-986bdd64-758e-4be2-8a6d-cbfd70fae215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:29.580014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:29.580912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 333/666] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.586845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.587589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.599919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:29.601089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:29.606424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.607442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.607936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.608407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.618126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.619583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:29.634705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:29.635654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:29.637213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 334/667] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:29.638497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.679366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 334/668] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:29.680149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.753373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096668-9fbb-40c9-89fb-9bac358def3d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.784095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.791554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.792929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.793680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.793680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.797804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:29.805557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4f93-c2ed-427f-9d75-fa4fd8673b29 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.851696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:29.852364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:29.852644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:29.852913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:29.853698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:29.854002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.856133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.873236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 335/669] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:29.873236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:29.874877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:29.876355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:29.981168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5567-8a4a-41f1-8d0c-9bcca2fd8f18 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:29.982936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 335/670] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:29.983744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.014273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.020979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.021643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.021924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.022230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.023017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:30.023328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.024748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.036646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 336/671] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:30.037431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.052338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.089253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a786d-f33b-4c31-9029-0b7d7f7fabf1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.123277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.124064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.124347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.124625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.135046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:30.137816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6cc7-6b31-43d8-aa96-15add440b40b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:30.143147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:30.144243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:30.145089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 336/672] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:30.145832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.173620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.174300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.174583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.174866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.175686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=68d8d9ddbe0c4ebb920c126f0122ce33) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:30.175996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.177398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e9db-676d-4f1e-ab72-2ab0b87cdda7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.183752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 337/673] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/role_assignments?user.id=68d8d9ddbe0c4ebb920c126f0122ce33&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:30.184959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e013f-b3b7-4114-833e-c46f79148a1c None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.185245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e013f-b3b7-4114-833e-c46f79148a1c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.185520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e013f-b3b7-4114-833e-c46f79148a1c None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.186836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 338/674] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:30.187541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e013f-b3b7-4114-833e-c46f79148a1c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.264453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.275151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb28f-c3c4-405d-8f36-b7616c1b8aa6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.281613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.307963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e013f-b3b7-4114-833e-c46f79148a1c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.316164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.316980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.317263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.317535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.330451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.331931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.349982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:30.350533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:30.351405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:30.352262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:30.352262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:30.352262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:30.352262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:30.352262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 337/675] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:30.352805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.353491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.353784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.354066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.355135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=c58212e67bed45fc9c573568eea16b14) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:30.355455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.356920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac022a9-f347-4bf1-9dac-dddf9f7fd1fe None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.363676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 339/676] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/role_assignments?user.id=c58212e67bed45fc9c573568eea16b14&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:30.364951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.365241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.365517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.386981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:30.388250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:30.480201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 340/677] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:30.481879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.493363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4dab-ef30-474c-b8a6-bf4294d04a64 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.536438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.537137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.537421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.537704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.538693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:30.539021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.540473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.558203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 338/678] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:30.558203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.561098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.588574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.631085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a609d2-8470-422e-914a-9834ce6d6320 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.676416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.677082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.677360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.677629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.678396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:30.678967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.680068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.693261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8980-5ae9-4563-905b-d45b4db1060b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.698135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 341/679] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:30.698135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.734327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.735528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.735991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.736273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.753407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:30.763804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:30.764756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:30.765578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 339/680] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:30.766298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.831795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033e85-357a-4862-9398-90c6795f527f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.843876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.867130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:30.871765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.872839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.873330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.873837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.886897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.888735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.895646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8640-dc40-4257-8f7b-2d5895cfcdf6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:30.908553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:30.909466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:30.910394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:30.910394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:30.910394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:30.910394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:30.912936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 342/681] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:30.913999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:30.937050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:30.938638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:30.939147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:30.939629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:30.949308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:30.951592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:30.971060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:30.971981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:30.972928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:30.975580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 340/682] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:30.976576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.038335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1808a-e1bb-401e-a087-0161cb18f5f3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.079313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.080218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.080607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.080986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.081899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.082286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.083756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.093970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 343/683] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.095008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.113426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023de070-fc8b-496a-b9de-f2bfe128cef3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.140488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.156130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.157770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.158706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.158994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.159291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.160714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.161051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.163268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.179131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 341/684] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.180070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.220014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a1ef8-0849-4db4-a5d3-7fb321a10f10 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.258291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.259409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.259910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.260411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.261761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.262380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.264007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.283475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 344/685] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.284648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.311268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc380f6-22e4-4a0c-812a-e088670bccf4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.356013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.357044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.357336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.357616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.373156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.374682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:31.399314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:31.400285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:31.401161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:31.401161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:31.401161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:31.401161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:31.405517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 342/686] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:31.406423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.410839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a34f94-fe37-40ef-b736-021ee1ce695b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.421447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.457247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.465561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.466786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.467211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.467699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.475948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.477574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:31.496017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:31.497125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:31.498219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:31.500305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 345/687] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:31.501281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.536838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e5856-7b8a-4cb1-9b88-6ae80d0fdfa5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.580126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.581199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.581625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.582042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.583059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=4c9d6becc7f8440e88cc2a3a043ac824) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.583515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.585087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.592818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 343/688] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/role_assignments?user.id=4c9d6becc7f8440e88cc2a3a043ac824&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.593799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.640421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e1cf-649f-459b-b104-3e15d762ba0e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.746869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.747561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.747845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.748120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.748864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.749174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.750577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.751657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.755095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45c60e-69ea-4234-a2bc-cbad899f3a2f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.784418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 346/689] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.788296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.823750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.825984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.833129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.833129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.833129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:31.833451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.835835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:31.842139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:31.866692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 344/690] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:31.869429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:31.942620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03af1d6-e74c-4294-8a57-7e7c1418e267 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:31.984333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:31.985467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:31.985893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:31.986364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:31.996453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:31.998202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.003030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f9e5-c275-4f28-8642-f3d78a4a16ad None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:32.015417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:32.016581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:32.017737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:32.020009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 347/691] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:32.025998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.050625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.051286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.051566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.051842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.087337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.139772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.141388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.155320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.183933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456309-f92c-4933-9392-b6359317dfe9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.248893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.249982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.250491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.251000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.252158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:32.252764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.258322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.286742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 348/692] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:32.294430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 345/693] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 12:46:32.295132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.299507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.382484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.430413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8529e-bfd7-4a65-9e0f-4c5d08dcc12e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.472244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ff1d6-eeca-43f2-a603-5d6524bcd03c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.502463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.503045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.503326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.503602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.535801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.554843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.555660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.555946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.556224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.587240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.588730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.602635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.604146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:32.634947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:32.636529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:32.637402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:32.637402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:32.637402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:32.637402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:32.637402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 346/694] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:32.647065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.712905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 349/695] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 12:46:32.718945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.766144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.813218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8347163-5020-4f86-9403-9f629bff2167 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.830139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:32.838336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a8036-14e4-4ad3-b945-410addcc79b3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:32.872294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.873716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.874256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.874739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.875903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:32.876418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.876833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:32.877648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.878628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64282-23ab-4c16-8214-882a49f15392 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.886365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.887321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.892888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 347/696] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:32.894323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ffff-0ee3-4023-bf7a-30b35eda16f0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.894616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ffff-0ee3-4023-bf7a-30b35eda16f0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.894895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06ffff-0ee3-4023-bf7a-30b35eda16f0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.900464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 348/697] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:32.900464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06ffff-0ee3-4023-bf7a-30b35eda16f0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:32.905595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:32.907455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-48faab60-addc-4968-a92a-891cc962ead0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:32.927482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:32.928373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:32.929244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:32.929244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:32.929244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:32.929244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:32.931606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 350/698] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:32.933358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:32.933880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:32.934475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:32.952799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:32.954509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:33.004180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06ffff-0ee3-4023-bf7a-30b35eda16f0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.034369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 351/699] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:33.034369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.042919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.043710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.043994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.044270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.051667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.053255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.066850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e0fc7c5a-5c4a-4b8e-a76b-5339212c5eed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:33.069999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:33.071069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:33.072149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.077550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 349/700] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:33.078913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6251-79e3-4c68-8c40-cf0a9babbaa1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.079204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6251-79e3-4c68-8c40-cf0a9babbaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.079480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6251-79e3-4c68-8c40-cf0a9babbaa1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.080931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 350/701] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:33.081487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd6251-79e3-4c68-8c40-cf0a9babbaa1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.112869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.152196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196b62-c778-48a6-afd7-48cc54af3886 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.188752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.189425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.189713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.189991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.190748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.191080 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.192418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.194167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd6251-79e3-4c68-8c40-cf0a9babbaa1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.209028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 352/702] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.209696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.232042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.232857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.233140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.233424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.234085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.235503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d583448f-8363-4e4b-b1e5-2e661c6284e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:33.249706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:33.250746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.251605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 351/703] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:33.252849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.252849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.252849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.271840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:33.273040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:33.314821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.330615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba36d9-b9e5-47f8-bfbb-9f203fd1e6aa None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.354143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 352/704] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:33.354143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.381242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.381674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.382277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.382555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.382851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.383680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.384075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.385773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.399315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 353/705] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.400049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.467753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4a80-83fd-4ffd-87e8-110ba899e69e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.503944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.504839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.505020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.505299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.509040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776824-d536-42ce-b6b2-b8c9e823f8aa None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.512555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.514012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:33.528445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:33.529352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 353/706] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:33.530851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.552033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.552856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.553145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.553419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.554155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.554468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.555844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.561194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 354/707] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.561810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.575523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.625933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.643441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874973-2f79-49fe-97c2-56fa0459b359 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.670289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9caf96-1c71-42cd-bb83-e0e055baac36 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.686833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.687633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.688064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.688311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.700808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.702312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.704421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.705076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.705358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.705633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.706487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=2871bcf4578040648c19fb6eb9464261) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.706800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.708203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.722155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 355/708] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/role_assignments?user.id=2871bcf4578040648c19fb6eb9464261&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.722155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:33.722411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:33.723271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 354/709] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:33.724130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.823347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.853182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc48-a154-4211-ab4d-0850627644f5 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.873555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbdde0-c57d-4acf-a2f8-5403add5784f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:33.893534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.894795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.895358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.895638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.896702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.897018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.899002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.916322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 356/710] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.917747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:33.918894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:33.919666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:33.920047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:33.920718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:33.922508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:33.922830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:33.924243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:33.929332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:33.934298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 355/711] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:33.935230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:34.079413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1305b8-3d71-4260-ae83-ae2f3fbd969c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:34.119057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:34.119656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.120463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.120745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.121488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:34.121795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:34.123228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:34.124958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:34.137443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 357/712] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:34.143245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:34.234943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344967d-1567-4847-872d-8ee7b22b960c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:34.261327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971bcc-c045-41d4-9217-b486b0421d5b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:34.274552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:34.275293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.275525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.275758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.277272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:34.277635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:34.279396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260ad3-cd6a-49f2-b86e-af9bccd95eb0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:34.285884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 356/713] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:33 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:34.287339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18b4e-8ff8-454a-b58f-26902f6af38f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.287631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18b4e-8ff8-454a-b58f-26902f6af38f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.287906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18b4e-8ff8-454a-b58f-26902f6af38f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.289459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 357/714] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:34.307363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.308338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.308708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.309328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:34.310232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.310784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.311217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.312095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:34.313713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:34.330149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:34.331670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:34.346885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 358/715] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:46:34 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:46:34.422146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:34.432300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 358/716] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:34.466601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:34.536954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:34.601249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681e5dd-4ad0-4335-84ca-ac7be84eb7f7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:34.636744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:34.637546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.637827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.638162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] PATH_INFO: `/v3/services/network` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.638872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:34.640238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:34.654667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:34.655720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:34.656987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 359/717] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:34 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:34.663263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:34.794601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef11b5-9768-441a-add0-8c238c2f8724 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:34.834574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:34.835300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:34.835583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:34.835908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:34.836635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:34.836942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:34.838351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef6f9f-40a6-4ac3-b726-50818e9d69b3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:34.843701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 359/718] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:34.848785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:34.982858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ef7b-167a-4715-b0ca-b90d87b06211 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:35.007324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:35.029446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:35.030136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:35.030418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:35.030691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:35.031397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] RBAC: Adding query filter params (type=network) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:35.031697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:35.033071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ea31-4635-4ca7-8680-0918f069726e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:35.039068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 360/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:36.731750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ddb4-e92d-4e34-b862-2f35c4e4d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:36.732415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ddb4-e92d-4e34-b862-2f35c4e4d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:36.732415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ddb4-e92d-4e34-b862-2f35c4e4d6f0 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:36.733931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 360/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:36.735719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27e42-037c-4eae-8a4c-6994166b2662 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:36.736215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27e42-037c-4eae-8a4c-6994166b2662 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:36.736370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b27e42-037c-4eae-8a4c-6994166b2662 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:36.737792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 361/721] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:36.739698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a7cb-b4f0-447b-b9e2-982d29c5177f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:36.739989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a7cb-b4f0-447b-b9e2-982d29c5177f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:36.740269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0a7cb-b4f0-447b-b9e2-982d29c5177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:36.745890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:36.745890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:36.745890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:36.763938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:36.765484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:36.767106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4ba0a7cb-b4f0-447b-b9e2-982d29c5177f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:36.768281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4ba0a7cb-b4f0-447b-b9e2-982d29c5177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:36.848783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 362/722] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:36.873856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:36.884362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 361/723] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 12:46:36.891226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:36.916150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d823-bedb-4d2e-b8db-b7aae04076e4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:36.916460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d823-bedb-4d2e-b8db-b7aae04076e4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:36.917279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d823-bedb-4d2e-b8db-b7aae04076e4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:36.923070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 362/724] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:36.923953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904d823-bedb-4d2e-b8db-b7aae04076e4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.023348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227e89-49f6-42a2-9cdb-aa570e505cf8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.036725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.038252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904d823-bedb-4d2e-b8db-b7aae04076e4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.075803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.076479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.076765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.077042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.077766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.079177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4bcc-e094-465c-b7ad-9b4bbf694a7d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.079871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.080913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.081395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.081864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.096718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:37.105864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:37.106905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:37.107728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:37.108379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 363/725] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:46:36 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:37.108379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.108379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.108566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.110993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 363/726] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:37.117056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.147625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:37.149126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:37.185962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.256730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9fe3a-2c66-4d32-b0d5-a8ff64c8f28d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.309136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.309974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.310294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.310571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.311345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:37.311655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.313516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.326071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 364/727] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:37.334067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.353429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 364/728] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:37.389964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.454600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff810f-40e4-476a-89ff-d2f48c14a952 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.462398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.493698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.494529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.494987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.495269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.507226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.508742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:37.529059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:37.530002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:37.530917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:37.530917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:37.530917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:37.530917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:37.534512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.534640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 365/729] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:37.536758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.537419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1a7b-fe96-48e2-ad32-5fefea918978 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.580720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.581536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.581879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.582261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.593650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-596afeda-fabb-4815-93a6-4fe80782d866 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:37.601397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:37.603507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:37.606003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 365/730] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:37.612771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75614-36db-4af7-82f4-f2f06c4ea264 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.612771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75614-36db-4af7-82f4-f2f06c4ea264 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.612771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75614-36db-4af7-82f4-f2f06c4ea264 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.613239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 366/731] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:37.614078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75614-36db-4af7-82f4-f2f06c4ea264 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.656135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5260-d3d3-4856-a817-b308a836862f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.712064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.712730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.713012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.713285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.714811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:37.715123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.716528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925f38e-c0fc-4cf8-b344-169790b2fadf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.736543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 366/732] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:37.737141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.737141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.737464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.747374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75614-36db-4af7-82f4-f2f06c4ea264 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.757578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:37.758869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:37.777147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.794366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.795063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.795349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.795628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.796382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:37.797374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.798890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.814235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 367/733] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:37.815167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.838381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:37.848848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 367/734] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:37.850179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:37.919359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48aa-a2c1-4750-afcd-e0a55db9efce None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.955862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:37.956670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.956958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.957238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.958310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cd2b3-1b3c-44f6-99f8-2918de58ccc2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:37.965644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:37.967581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-cee0e33d-cbf4-4eac-bfd5-e50c23056f3e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:37.983327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:37.984249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:37.985191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 368/735] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:37.986567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3106-e72b-4472-a38c-c121fb13aa00 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:37.986567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3106-e72b-4472-a38c-c121fb13aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:37.986567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a3106-e72b-4472-a38c-c121fb13aa00 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:37.987839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 369/736] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:37.988441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a3106-e72b-4472-a38c-c121fb13aa00 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.005240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.006727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.007007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.007281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.018297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.019933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.028563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c13c080c-e700-4084-a585-7137a38ea5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:38.037927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:38.038854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:38.039803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:38.039803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:38.039803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:38.039803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:38.039803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 368/737] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:38.044907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.045198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.045476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.063451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:38.064624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:38.080700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.102948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a3106-e72b-4472-a38c-c121fb13aa00 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.138945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 369/738] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 12:46:38.139643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.155524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.156953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.157442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.158154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.174873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:38.185186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:38.186134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:38.186967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:38.187591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 370/739] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:38.188303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.251537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78da973-1429-4d1d-84b8-52b61370ee65 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.282638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.290946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.292109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.292429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.292670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.293503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:38.293810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.295279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.296051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3170a3-b824-4f6a-98ee-3d4e08753bfc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.319133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 370/740] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:38.319133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.334983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.335650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.335937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.336212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.336954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:38.337250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.339274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.347997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.356279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 371/741] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:38.356279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.433784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a916ee2-d1ff-4731-b2fc-5c1bde1d6774 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.466230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b341-1675-4167-ba52-d0a4aad5ca8e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.469804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.470679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.471102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.471519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.472396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.474297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.489858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 371/742] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:46:38 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:38.491108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.537528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.538247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.538615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.538800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.539578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:38.539885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.541326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.553779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 372/743] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:38.554828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.566977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.623271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.629001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017524-f9ec-40a4-a01a-2479194b22de None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.667293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.668452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.668932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.669417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.672180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56cf28-6afb-453c-812c-704f0adab84f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.712014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.712014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.712446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.712600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.723506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.725124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:38.740532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:38.741471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:38.742419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 373/744] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:38.742981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.754222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.757287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.838581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.877577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd48ac-0a4c-4ff7-b00b-2dc753f6f2b1 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:38.878591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 372/745] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:38.879720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:38.906135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:38.938628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:38.939906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:38.940393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:38.940978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:38.961564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:38.964925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:38.995448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdf2a-a719-4bc2-a2c1-357e5f532f1a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:39.000520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:39.001378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:39.002288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:39.002288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:39.002288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.002288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:39.010039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 374/746] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:39.012078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.035303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.036408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.036897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.037400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.038513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:39.039027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.040764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.060618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 373/747] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:39.061819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.078440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.152452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd280e-b113-4bf6-a4ad-e1e2ae9b0995 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.174515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c4561-8676-4000-b946-0436a6ba2a0f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.191363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.192282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.192568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.192845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.207598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.209059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.210946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.211730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.212113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.212507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.213335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:39.214619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.215898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.228020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 374/748] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:39.229040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:39.229784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:39.231407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:39.232325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:39.232325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:39.232325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.232325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:39.232325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 375/749] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:39.237168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.263019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.317412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.355537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622353b-a267-46a0-867c-f92f30f8172b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.362517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985100e-17ed-437c-9e81-e5199c3494ad None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.398296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.399261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.399675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.400141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.407126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.408244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.408732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.409210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.417281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.418937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.420486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.422899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:39.439629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:39.440792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:39.441687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:39.441687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:39.441687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:39.441687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:39.442539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 375/750] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:39.443671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:39.444252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:39.445141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:39.446069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:39.450346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 376/751] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:39.451550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.571652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377ea34-b772-4c46-894d-30bb2c4ce24c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.593105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.618374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.619226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.619618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.620235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.621126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:39.621543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.623111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.639182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 376/752] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:39.640304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.697471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.718764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752efa11-00d4-4083-9e10-92d7b4603d5d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.751806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.752169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359c8-a8b6-455c-8dd6-dc4cf30babad None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.752475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.752757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.753031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.753759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:39.754065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.755457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4dbd4-eb16-4c86-a398-4ec3403e7fc6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 377/753] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcac9b-1ab2-4675-8221-7da16e89ce51 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcac9b-1ab2-4675-8221-7da16e89ce51 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcac9b-1ab2-4675-8221-7da16e89ce51 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 378/754] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:39.771852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcac9b-1ab2-4675-8221-7da16e89ce51 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.798877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.799556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.799842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.800119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.800962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:39.801276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.802749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.825459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 377/755] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:39.825459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:39.863790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.890283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcac9b-1ab2-4675-8221-7da16e89ce51 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.926509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.927310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.927592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.927871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.935723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.937162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:39.937270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370567-6108-4728-b0ea-572242ab47ca None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-6130bb90-12c8-4ad1-a361-761ae4c2b7b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:39.952411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:39.953284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:39.954174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 379/756] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:39.954744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.955124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.955293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.960529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:39.973684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:39.974915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:39.980914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:39.981713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:39.981995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:39.982300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:39.989370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:39.990857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:40.006136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:40.007288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 378/757] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:40.008155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.051765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 380/758] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:40.053068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.120607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.127183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0515e5d-4a3b-4aa0-aeb3-80469117d0c6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.161762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8c2b-c528-4fa5-b00e-c72e8a7cb478 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.166371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.167110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.167500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.167780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.193869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.200486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.201148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.201435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.201713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.202597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:40.202853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.204262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.221837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 381/759] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:40.221837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.250016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.251936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.325788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc164db-90c6-44db-8485-6520cb1b11d9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.357988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.361821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.362458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.362749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.363023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.363817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:40.364126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.365557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.366292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 379/760] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:40.367044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.385104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 382/761] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:40.386839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.445963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.486362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df537c-6bac-4c2d-961e-e36682bc5a78 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.495961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cab62-2683-4506-b46d-345e9db8129c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.530215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.531456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.532129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.532616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.532740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.533264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.533547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.533821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.534362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.534681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=2871bcf4578040648c19fb6eb9464261) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:40.534991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.536401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.536630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.542534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 383/762] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/role_assignments?user.id=2871bcf4578040648c19fb6eb9464261&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:40.543517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:40.550918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:40.551938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:40.552804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 380/763] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:40.553662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.642376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.674829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0979-e462-4da4-8ef7-0cedf6bed100 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.694297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528be4d-699e-4485-93d5-09d420a0d29b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.695585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.717957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.719156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.719651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.720186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.733236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.735110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.737379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.738675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.738675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.738961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.740964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=0532ebb4e77b41179663accaa80e4942, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.742492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:40.756882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:40.757825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:40.758806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:40.758806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:40.758806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:40.758806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:40.758806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 384/764] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:40.760068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.763281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 381/765] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:40 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:40.769324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:40.918582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a181e6-a604-40d7-bfdf-1d5cf9f365b1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:40.941514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:40.957914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:40.958629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:40.958919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:40.959201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:40.960018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:40.960332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:40.961903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:40.976832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 382/766] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:40.987150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.017233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0201-4084-4c97-9677-223c145080c2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.064472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.065498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.068719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.069206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.070145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.070651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.072214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1cf97-c205-43d1-9861-afe822bb2b62 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.078769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 385/767] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.080328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b422d6-a57d-4aa1-8f69-2b2d5ca0e8be None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.080828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b422d6-a57d-4aa1-8f69-2b2d5ca0e8be None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.085589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b422d6-a57d-4aa1-8f69-2b2d5ca0e8be None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.087465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 386/768] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:41.088561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b422d6-a57d-4aa1-8f69-2b2d5ca0e8be None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.126556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.129143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a833e-d0a0-4dbf-99ba-5b2a14b25e54 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.169378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.170598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.171096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.171577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.178942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.180655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c7b50faf-7d1d-4156-ae29-1ab79b2e16f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:41.196010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:41.196913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:41.198310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:41.201136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 383/769] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:41.202593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.203102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.203579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.207380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b422d6-a57d-4aa1-8f69-2b2d5ca0e8be None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.228155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:41.230519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:41.245614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.246675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.247161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.247632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.248591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.249114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.250709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.262242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 387/770] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.263388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.274682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.314018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 384/771] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:41.315336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.395366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.402874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae21447-4440-4465-8219-7b53d0f029af None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.429737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583cd42-6e84-4829-984c-be8fa040f89a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.451396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.452071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.452356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.452634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.453432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.453742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.456043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.470472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.471491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.471968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.472411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 388/772] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.472661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.473342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.474233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] RBAC: Adding query filter params (interface=public, service_id=fb0d5f8fa5d146dc83c2989b5ee046f4, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.474748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.476370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.490588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 385/773] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/endpoints?service_id=fb0d5f8fa5d146dc83c2989b5ee046f4&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.491769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.535297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.591911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376866a-637f-444d-974a-b4855a03a593 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.625931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e687b-9753-4deb-b7f6-88c62aff5401 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.630744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.632121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.632597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.633060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.633917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.636308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:41.649399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:41.650394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:41.652360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:41.655416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 389/774] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:41.656606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.666347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.667739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.667920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.668102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.669473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=7229ef6d88a04c57b7e83485be988aee) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.669804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.671287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.679921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 386/775] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/role_assignments?user.id=7229ef6d88a04c57b7e83485be988aee&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.680849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.686672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.887596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f46646-d8ae-465d-9f54-7a9d6491f4b9 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.893406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:41.899839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b690c6-b683-44bb-80ee-f3849152e6c2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:41.943068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.944486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.944918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.945343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.946231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:41.946702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.948329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.953745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 387/776] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:41.959286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:41.969132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:41.970036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:41.970511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:41.970931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:41.971769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:41.974140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:41.987776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 390/777] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/services => generated 772 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:42.092594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731009d-9e7e-4041-ac6a-4d8bce4be1d6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:42.141831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:42.142466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:42.142751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:42.143023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:42.143755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] RBAC: Adding query filter params (type=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:42.144045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:42.145441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:42.152587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 388/778] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:42.158444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:42.285964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:42.310601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbcfde-de94-429f-949a-6eef4aff7b7c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:42.346475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:42.347138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:42.347436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:42.347700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:42.348481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] RBAC: Adding query filter params (interface=public, service_id=361ce4038697492eb6e5c5db9b070884, region_id=RegionOne) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:42.348795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:42.350187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de1e2-2785-4a5a-a28e-038aeaf0f2e5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:42.358688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 391/779] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:46:42 2022] GET /identity/v3/endpoints?service_id=361ce4038697492eb6e5c5db9b070884&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:42.363765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:42.397238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:42.474352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80546077-89d1-4190-b764-301b1ef06d1d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:42.515866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:42.516991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:42.517473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:42.517946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:42.518881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:42.520479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048344-039c-4bf4-8a62-27c015cc65c1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:42.531373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 389/780] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:46:42 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:43.037644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf6f7-e388-484d-88c4-1f0095220ef7 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.038386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf6f7-e388-484d-88c4-1f0095220ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.038968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf6f7-e388-484d-88c4-1f0095220ef7 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.040814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 392/781] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:43.047590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2857f1-5be0-4e35-a5bf-2ee0769a34f3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.048063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2857f1-5be0-4e35-a5bf-2ee0769a34f3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.048141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2857f1-5be0-4e35-a5bf-2ee0769a34f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.071567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-de2857f1-5be0-4e35-a5bf-2ee0769a34f3 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:43.072855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-de2857f1-5be0-4e35-a5bf-2ee0769a34f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:43.164178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 390/782] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:43.199950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf6f7-e388-484d-88c4-1f0095220ef7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:43.359464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf6f7-e388-484d-88c4-1f0095220ef7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:43.405097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473e5-624c-4c53-abc7-ad9b31156794 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.405435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473e5-624c-4c53-abc7-ad9b31156794 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.405654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473e5-624c-4c53-abc7-ad9b31156794 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.407353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 391/783] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:43.412287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525999-d040-49db-9e46-57fc9c23064a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.412571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525999-d040-49db-9e46-57fc9c23064a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.412842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525999-d040-49db-9e46-57fc9c23064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.416155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:43.417488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.417774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.418052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.441031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-47525999-d040-49db-9e46-57fc9c23064a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:43.442283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-47525999-d040-49db-9e46-57fc9c23064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:43.444601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:43.453050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:43.453984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:43.454839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:43.455932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 393/784] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:43.461866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:43.476543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:43.480986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:43.567590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 392/785] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:43.603034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525999-d040-49db-9e46-57fc9c23064a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:43.625168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09001bfb-352f-4512-a6ac-77e3eef24464 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:43.684058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:43.684743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.685030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.685308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.686065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:43.686404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:43.688123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:43.701565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 394/786] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:43.707359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:43.780978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525999-d040-49db-9e46-57fc9c23064a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:43.835998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:43.848467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:43.849274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.849554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.849829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.870275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:43.882027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:43.882950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:43.883782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 393/787] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:43.892062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:43.899052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592519a9-b422-49f5-983e-6d1da7b5e4e4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:43.917851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:43.946404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:43.946404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:43.946404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:43.946404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:43.960225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:43.961664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:43.992029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:43.993151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:43.994082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:43.994082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:43.994082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:43.994082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:43.995579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 395/788] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:44.003891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.100289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4273cf-51f0-4d5f-8312-dfbe30a713ce None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.150303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb68dcc-538d-4ab0-8f40-f15f1ea6cf6d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.183525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.184205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.184490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.184771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.185531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:44.185841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.187257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.198460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.207849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.208557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.208791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.209069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.209816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 394/789] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:44.209924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:44.210203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.211673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.216410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.231830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 396/790] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:44.236983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.341917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.382009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651e35-6e07-4f7c-a92e-22ab9b2bd9a0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.430972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.431791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.432374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.432792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.444664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.446140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.451125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82a8a-9ed2-48d2-ab46-c3c39343ad99 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-df39fcf8-0e72-4585-a117-cc49d4ad6de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:44.465333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:44.466468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:44.467580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:44.467580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:44.467580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:44.467580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:44.467580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 395/791] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:44.468109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26d61-95c8-4825-9149-ebf330cc5b7d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.468387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26d61-95c8-4825-9149-ebf330cc5b7d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.468666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26d61-95c8-4825-9149-ebf330cc5b7d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.474339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 396/792] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:44.475131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e26d61-95c8-4825-9149-ebf330cc5b7d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.497985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.499045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.499476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.500431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.511730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.513347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-1abe67ca-36ee-44e3-a30b-35c3f5fc156f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:44.534138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:44.535320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:44.536478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:44.539739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 397/793] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:44.542358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.542912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.543363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.565773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:44.567937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:44.591934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e26d61-95c8-4825-9149-ebf330cc5b7d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.616884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.618826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.636572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.637890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.638430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.639471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.640770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:44.641249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.643725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.663027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 397/795] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:44.664418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.666653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 398/795] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:44.671575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.796971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4139f-3faa-4bcc-87f2-607da74f83a0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.805503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965088a8-614f-467c-bcb8-b86afcaef4bd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:44.840956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.842155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.842984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.843680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.844954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:44.845829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.847747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.850206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:44.851553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.851553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.851553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.859690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:44.861127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:44.867706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 398/796] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:44.871013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-40afb4d0-426f-4d5d-ba82-2dd1d53a0999 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:44.876355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:44.877263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 399/797] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:44.878874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d850b8-1b0b-4959-9947-ef880b809ba7 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:44.879514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d850b8-1b0b-4959-9947-ef880b809ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:44.879514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d850b8-1b0b-4959-9947-ef880b809ba7 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:44.880865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 400/798] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:44.881838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d850b8-1b0b-4959-9947-ef880b809ba7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:44.920271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.934403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:44.996809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e783c31-4422-40db-96d8-27c9898555e6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.032070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d850b8-1b0b-4959-9947-ef880b809ba7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.047916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.048827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.049117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.049396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.063432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:45.071197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:45.072100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 399/799] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:45.073167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.080619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.081421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.081706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.081979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.094424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.095896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f3459df4-a6cc-4130-b19b-d89a3f7897bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:45.117520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:45.118793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:45.120248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:45.120248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:45.120248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:45.120248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.121082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 401/800] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:45.122408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.122700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.123003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.140514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:45.141737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:45.183386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddedad-4918-4e63-9f4c-2d8d442b854c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.185359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.218177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 402/801] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:45.218177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.229238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.230330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.230815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.231299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.232352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:45.232871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.234493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.246675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.254761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 400/802] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:45.255611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.339330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6839c-631d-46a9-873d-1fefb3175a89 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.367048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9adda-0455-49c7-80ab-f3e69edf13b4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.378457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.379146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.379430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.379706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.380457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:45.380753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.382416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.395370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 403/803] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:45.395370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.414996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.415665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.415947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.416223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.417521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:45.417920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.419334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.430766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 401/804] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:45.431557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.452730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.472725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.496330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61391a-88cb-4723-ba44-c87324014426 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.530840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.531333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a31dd-604a-4eae-b1ed-f26302e5ab78 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.531650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.531939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.532218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.532872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.534280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:45.546635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:45.547567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.548384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 404/805] 10.222.0.36 () {56 vars in 1129 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:45.549789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.567632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.568277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.568559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.568833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.639371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.640840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.649269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4989-25fa-41d6-83c6-a239f7819f5d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.660983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.684328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.685112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.685403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.685680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.694363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.696794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.698829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7c43f928-7bec-481e-9dcb-8cc2c48d78be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:45.716309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:45.717169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:45.718731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:45.718731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:45.718731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:45.718731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.718731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 405/806] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:45.719071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bcfe-78f7-4230-8388-ff554358c8e5 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.719251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bcfe-78f7-4230-8388-ff554358c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.719527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bcfe-78f7-4230-8388-ff554358c8e5 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.720804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 406/807] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:45.721497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bcfe-78f7-4230-8388-ff554358c8e5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.745934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 402/808] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:45.746809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.826600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bcfe-78f7-4230-8388-ff554358c8e5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.843804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a8142-1df4-4a7f-af69-76074742d6e2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:45.860266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.861054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.861342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.861618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.864167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.868999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.870640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.878492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:45.879149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.879433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.879711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.880416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:45.880724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:45.882374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4487-1901-4139-a89e-12a68b7b7810 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:45.884923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:45.886823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 407/809] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:45.888248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.890333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 403/810] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:45.892011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:45.892342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:45.892582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:45.909427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:45.910628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:45.943693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:45.978322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 404/811] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:45.979177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:45.992611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a194b4-925e-4110-9c58-fb7117516e5e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.027579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.028249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.028530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.028805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.029520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.029825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.031221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.042699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 408/812] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.043504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.089388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daf839-3a3a-41e5-a261-6dcbad1596b1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.103059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.123718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.124513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.124796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.125070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.135807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.137500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.144041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ed7d-7fa9-482e-8834-5dfb89b44955 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:46.155417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:46.156522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:46.162534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:46.162534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:46.162534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:46.162534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:46.162833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.162920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 405/813] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:46.162920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.185126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.185798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.186085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.186398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.187110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.187419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.188791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.193665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 409/814] 10.222.0.36 () {56 vars in 1124 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.194471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.257111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb8751-285c-4d97-83ae-d816230ede88 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.292388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.292946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.293232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.293509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.293599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab771e6-882d-48dd-81de-8080fff6eb9b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.294335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.294648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.296104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.307719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 406/815] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.308522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.328388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.329184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.329470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.329809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.330497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.331857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.338975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:46.344373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:46.345544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:46.346403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 410/816] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:46.347195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.387710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.421055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdff71-4926-46fa-9726-0d570eea9c18 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.446185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3db37-fd09-44bf-b81b-2dc9c0015df2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.455614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.456432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.457028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.457311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.464818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.466303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.479746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.480401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.480685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.480962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:46.481293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:46.482232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:46.483152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:46.483683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.483683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.483811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 407/817] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:46.483811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.483940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.498925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 411/818] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.499719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.571600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.587197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ab51e-aa5a-4804-a2fa-c28e67bb2cf9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.598194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.601292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ec1f-2066-4ffe-94c9-09851d66e348 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.621250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.621896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.622207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.622486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.623216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.624581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.637595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.638584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.638860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.639130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/2871bcf4578040648c19fb6eb9464261/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.641103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=2871bcf4578040648c19fb6eb9464261, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.642523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.644955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 408/819] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:46:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:46.645770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.682464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 412/820] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:46 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/2871bcf4578040648c19fb6eb9464261/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:46.682464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.780571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d4f2-3545-4ed7-8463-0e39819e5433 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.822727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.824066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.824416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.824759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.825718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] RBAC: Adding query filter params (name=network) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.826201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.827721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.833842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 409/821] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.834983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.838020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.855050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46ac25-89eb-4360-a9e4-150c4ef749bd None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:46.903981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:46.904814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:46.905101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:46.905378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:46.906255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:46.906565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:46.908003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:46.932448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 413/822] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:46.934060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:46.955716 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:46.988557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba126050-f6ef-4f1a-9a69-71be2ee2df4f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.026069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.026944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.027230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.027604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.035218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.036812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.040026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fc7a1-969c-420d-9506-f260b48c5e91 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:47.052694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:47.053796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:47.054760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 410/823] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:47.055241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.077281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.077872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.078181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.078466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.079299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] RBAC: Adding query filter params (type=network) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:47.079611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.081050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.091629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 414/824] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:46:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:47.092684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.125277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:47.171778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882bbe7-b882-4a9e-90a1-196d44cca171 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.186313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:47.207147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514ab6-2c06-4c32-8e68-e7c422d69d32 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.211920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.212792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.213191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.214137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.225692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.227406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.244839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.245604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.245963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.246340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.247212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:47.247598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.249099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:47.249858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:47.250736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:47.251606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:47.251606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:47.251606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:47.251606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:47.255832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 411/825] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:47.257019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.263501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 415/826] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:47.264486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.377476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5044-ddd6-4499-850b-fb99dcaaabc6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.390141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3ed4c-fc4a-4847-b6e5-fe3788f21f06 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.395556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:47.419790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.420771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.421256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.421624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.422264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.422580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:47.422930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.423065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.423216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.423500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.424243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.424780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.425617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.442503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 416/827] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:47.444181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.447645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:47.458297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 412/828] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:46:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:47.460806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.668964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648958c-4ef3-4ae4-bed1-feb553c11dcb None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.699332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629239-4b50-406f-9caf-ebaf0acfcce2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.739598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.740280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.740564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.740838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.742431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:47.742762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.744197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.755865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 417/829] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:47.767133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.767965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.768250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.768525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.778696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.780278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:47.799905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:47.800841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:47.801800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:47.802686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 413/830] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:47.808834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:47.898504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:47.953544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14871f5f-1e63-44a5-827d-dabbfb6643f3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:47.993117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:47.993781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:47.994058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:47.994482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:47.995935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:47.996271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:47.997667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4a57-1f10-406f-87fb-79415fa57732 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:48.011755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 418/831] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:48.017424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:48.048508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:48.129757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca921-5688-4926-a029-18c6c3991b83 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:48.169606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:48.170997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:48.171497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:48.172030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/7229ef6d88a04c57b7e83485be988aee/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:48.187367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=7229ef6d88a04c57b7e83485be988aee, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:48.189121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726ee65-ba73-4c77-9687-bb48bc471051 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:48.204840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 414/832] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:46:48 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/7229ef6d88a04c57b7e83485be988aee/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:46:49.019493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602a27-2a8d-4012-9988-1c4af4a8bbc8 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.020018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602a27-2a8d-4012-9988-1c4af4a8bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.020018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5602a27-2a8d-4012-9988-1c4af4a8bbc8 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.021844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 419/833] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:49.027896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.028344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.028541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.045663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:49.046895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:49.110729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a4d2-dc57-4219-8242-8b9a5d07d0a9 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.111609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a4d2-dc57-4219-8242-8b9a5d07d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.112372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a4d2-dc57-4219-8242-8b9a5d07d0a9 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.114852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 420/834] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:49.118882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 415/835] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:49.123774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.124065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.124343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.141176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:49.142393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:49.148851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.157696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:49.230150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 421/836] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:49.254865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.265428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec40618-d39c-4d7e-abbb-fd268919b1c9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.310781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.312139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.312609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.313217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.326809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:49.336953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:49.338344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:46:49.339523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:49.340300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:49.347616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 416/837] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:49.349806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.368849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9da8d-eb65-4345-a39f-c70bfb23da7d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.418046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.418878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.419162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.419438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.420096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.421685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.431483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:49.435411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:49.436715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:49.437593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:49.438362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 422/838] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:49.447306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.477370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ea5a-cdde-44ab-9311-c55cddcaf8ff None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.515620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.516678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.517219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.517700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.518725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:49.519290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.520926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.535327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 417/839] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:49.536492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.573562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b36c4-17ec-4a59-a6f6-9b76b2f4ebc7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.615240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:49.618936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.621708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.622003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.622317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.623042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:49.623348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.625183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.636799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 423/840] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:49.638691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.655640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f729-1805-45ae-accd-a9196d8c9928 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.685565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:49.695452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.696627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.697220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.698502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.710562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.712559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:49.731967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:49.732890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:49.733837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:49.733837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:49.733837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:49.733837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:49.740782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 418/841] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:49.741941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:49.759787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cb7f3-eb89-45c4-8e96-0fe0d5f7c046 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.809002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.809676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.809953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.810271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.811239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:49.811549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.813702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.822210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 424/842] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:49.872656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26f26-fc7f-4eb3-937d-562dcf759fdb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:49.912592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:49.913274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:49.913571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:49.913851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:49.914698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:49.915012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:49.916726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:49.931341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 419/843] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:49.938508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.003591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.064137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f829-73cd-432f-9b7a-d879af41a0ff None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.102727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.104497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.104982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.105471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.113605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.115301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-8088fb1e-1a77-43a1-9bf9-8afaba06b309 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:50.130667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:50.131883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 12:46:50.132790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:50.136602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 425/844] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:46:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:50.142771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.176126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa3d0-ed44-49ea-8dc5-aa3b64d43f64 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.176434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa3d0-ed44-49ea-8dc5-aa3b64d43f64 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.176690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa3d0-ed44-49ea-8dc5-aa3b64d43f64 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.178342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 426/845] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:50.183995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.184281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.184558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.190654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.208950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:50.210473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:50.257090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8567dd-b54a-4494-bb66-4f13a7fb8658 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.294899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.296283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.296769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.297454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.299282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:50.299841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.301554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.302904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 427/846] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:50.324412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 420/847] 10.222.0.36 () {56 vars in 1135 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:50.325881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.330160 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.368136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.440611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da771178-a2ee-4635-9b2e-6c5c04b2afdf None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.466752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.473357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83f90-3861-41f2-90a3-21cc6e132048 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.481692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.482631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.482987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.483336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.484173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.485619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-273a8a76-512f-4726-91a8-f80909d47687 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:50.499471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:50.500433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:50.501258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:50.505576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 428/848] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:50.507302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a61d-8758-4721-aa8c-c4eb96dc4f3b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.507598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a61d-8758-4721-aa8c-c4eb96dc4f3b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.507880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a61d-8758-4721-aa8c-c4eb96dc4f3b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.509292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 429/849] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:50.514008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a61d-8758-4721-aa8c-c4eb96dc4f3b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.518465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.519115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.519395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.519667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.590747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.592218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.625718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a61d-8758-4721-aa8c-c4eb96dc4f3b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.627332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.663832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906184da-7f68-4348-9b16-97228822589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.664415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906184da-7f68-4348-9b16-97228822589e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.664701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906184da-7f68-4348-9b16-97228822589e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.664980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906184da-7f68-4348-9b16-97228822589e None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.665694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906184da-7f68-4348-9b16-97228822589e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:50.666049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906184da-7f68-4348-9b16-97228822589e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.667709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906184da-7f68-4348-9b16-97228822589e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.677003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 430/850] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:50.677003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.677003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.677003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.691299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:50.692490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:50.699304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.709289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 421/851] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:50.710204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.766178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 431/852] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:50.766178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.818803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821830d-f288-4de6-80a7-6ab8e826c1b9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.853234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.854533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.854819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.855099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.855808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:50.856399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.857495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.861985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 422/853] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:50.862800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:50.892858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.903278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9fbed-7494-4cde-85d3-e24b099f5be9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.945979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:50.958848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:50.959260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:50.959706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:50.960061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:50.974222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:50.975922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:50.994584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024724f3-e41e-4f9f-8070-f787dc8b7288 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:50.997636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:50.998561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:50.999420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:50.999420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:50.999420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:50.999420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:51.002588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 432/854] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:51.005325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.042962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.044209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.044690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.045159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.056880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:51.065634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:51.066758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:46:51.067745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:51.070030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 423/855] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:51.076352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.136445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb4179-32fa-4403-9a47-ff624aeddf65 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.185270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.186554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.187275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.187737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.189377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:51.189870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.191052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d2780-a257-4128-8f03-7ca8d8fe0c27 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.192036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.217427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 433/856] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:51.219291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.221709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.233977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.240540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.241522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.241949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.242401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.243320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:51.243887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.246028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.255134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 424/857] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:51.261812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.346350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880d8dc-666f-4cb7-92ee-65bc74f37090 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.389100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.390313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.390883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.391386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d16d3-9abe-4755-a118-59a0ac805dd5 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.391499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.400020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.402424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:51.421367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:51.422325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:51.423192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 434/858] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:51.428428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.435923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.437108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.437594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.438208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.451220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.453043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:51.476603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:51.477499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:51.478512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:51.478512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:51.478512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:51.478512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:51.478512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 425/859] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:51.484314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.505196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.521329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.540028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb449e82-7899-4010-9311-27c6a3060296 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.578441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.579122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.579409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.579690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.580489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:51.580915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.582371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.593436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dff1c-b619-40a1-b127-fe54d81d61b3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.600281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 435/860] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:51.601611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.630553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.631481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.631768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.632045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.632885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:51.633293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.635268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.653127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 426/861] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:51.654331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.712744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693357a6-acca-45e0-85df-a9f1c230fe19 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.748182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.757858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.758692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.759082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.759464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.761301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=2871bcf4578040648c19fb6eb9464261) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:51.761724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.763354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.778313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 436/862] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/role_assignments?user.id=2871bcf4578040648c19fb6eb9464261&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:51.787606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:51.796566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6108853-cb53-43c1-ba6a-1a3af40183cc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:51.835791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:51.836635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:51.836919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:51.837204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:51.846688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:51.848185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:51.864950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:51.868931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 427/863] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:46:51.874346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:51.988801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cab0e-01e6-44b5-9b0d-0d7d3f14f82c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.025918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.026624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.026911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.027187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.028046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:52.028358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.029829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a58e2b-2d82-419b-a19a-bb5abb176a08 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.051125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 437/864] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:46:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:52.057188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:52.166841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405985f-2cfb-48d8-b2e6-c7bfb04d4644 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.202147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.202905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.203064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.203349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.233024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:52.234563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303850e-78da-42be-99b9-3adbdd8e0247 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.238139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303850e-78da-42be-99b9-3adbdd8e0247 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.238139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303850e-78da-42be-99b9-3adbdd8e0247 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.238139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 438/865] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:52.241730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.242014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.242329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.259825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:52.261055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:52.279176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.280576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.325715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:52.358053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 439/866] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:52.383638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:52.409555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 428/867] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:52.410760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:52.474263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:52.500724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b5f9-19ea-4e89-96e8-2ae6d9241fa0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.526968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf52d-157b-4550-bad1-fdbac8329d50 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.536547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.537558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.537863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.538196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.538939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.540908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.566142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 440/868] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:46:52 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:46:52.587410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.589069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.589361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.589652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.602811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.604910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:52.624624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:52.625571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:52.626503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:52.626503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:52.626503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:52.626503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:52.630513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 429/869] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:52.632791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:52.683552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:52.752348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff717-b42f-4dc6-995d-4f60a4d16254 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.789660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.790303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.790589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.790866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.791703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:52.791992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.793353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.806036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 441/870] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:52.811929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:52.919416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694fea-7834-4f58-8b19-ebae2bfe6d8c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:52.922661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:52.964378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:52.965598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:52.966152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:52.966632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:52.974955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:52.976863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:52.992504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:52.993406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:52.994855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:52.997289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 430/871] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:53.002704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:53.116421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:53.120309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fbde5-7253-4b8a-bbc9-0d0c6772c78b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:53.158693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:53.159365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:53.159703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:53.159986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:53.160785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:53.161097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:53.162589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a248e2-fafe-4178-b8fc-fbcf52ebcefd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:53.176200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 442/872] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:53.181804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:53.272913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f5c9-9137-455a-b9ac-366f99e42ce4 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:53.273426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f5c9-9137-455a-b9ac-366f99e42ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:53.273667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f5c9-9137-455a-b9ac-366f99e42ce4 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:53.275515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 443/873] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:53.280206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af320a2-eb41-4ba2-b8b2-70962c3a91a8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:53.280502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af320a2-eb41-4ba2-b8b2-70962c3a91a8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:53.280838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af320a2-eb41-4ba2-b8b2-70962c3a91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:53.293187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450f11-0933-4b13-83cf-ad14c010fb25 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:53.300042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5af320a2-eb41-4ba2-b8b2-70962c3a91a8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:53.301570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5af320a2-eb41-4ba2-b8b2-70962c3a91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:53.340325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:53.341481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:53.342080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:53.342579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:53.343928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=7229ef6d88a04c57b7e83485be988aee) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:53.344459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:53.346441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:53.354032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 431/874] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:53 2022] GET /identity/v3/role_assignments?user.id=7229ef6d88a04c57b7e83485be988aee&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:53.394957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 444/875] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:53.418522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:53.461746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:53.551207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6620b3-22c7-4f4e-89da-832eca72cba6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:53.596885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:53.597559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:53.597843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:53.598139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:53.598883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:53.600280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736349b0-b6cb-4f5d-af5b-ec96a1228683 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:53.617179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 432/876] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:46:53 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:54.254779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ead8f-68d9-4d56-99e2-6dacf4d02432 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:54.255083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ead8f-68d9-4d56-99e2-6dacf4d02432 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:54.255338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ead8f-68d9-4d56-99e2-6dacf4d02432 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:54.258562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 445/877] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:54.264759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:54.265040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:54.265323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:54.283874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:54.286092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:54.376967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 433/878] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:54.397771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ead8f-68d9-4d56-99e2-6dacf4d02432 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:54.507745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:54.518213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ead8f-68d9-4d56-99e2-6dacf4d02432 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:54.554308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:54.555111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:54.555393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:54.555665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:54.556314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:54.558309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:54.570477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:54.571580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:54.573035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 446/879] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:54.580993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:54.648195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:54.690063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d173-5041-4790-9a53-5c77bbe8d27f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:54.725234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:54.725904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:54.726215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:54.726493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:54.727210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:54.727520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:54.729561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42cdb2-44cf-4fcb-a649-ff632176a674 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:54.735466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 434/880] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:46:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:54.741375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:54.855335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b1fe-a374-419a-b73c-f08ecf483aae None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:54.894425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:54.895124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:54.895410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:54.895689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:54.896421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:54.896732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:54.898445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779153b2-fb3a-497c-979e-1f49d34375f3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:54.904876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 447/881] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:46:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:55.099941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6b14-0bf6-4428-849f-22b6805bd1b1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.100316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6b14-0bf6-4428-849f-22b6805bd1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.100503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6b14-0bf6-4428-849f-22b6805bd1b1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.102047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 435/882] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:55.108224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.108466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.108752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.126698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:55.127952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:55.142480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:55.199852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 448/883] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:55.222391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f6b14-0bf6-4428-849f-22b6805bd1b1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:55.310932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:55.334318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f6b14-0bf6-4428-849f-22b6805bd1b1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:55.371109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:55.371831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.372116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.372395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.373056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:55.374555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:55.387779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:55.389225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:55.390043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 436/884] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:55.395151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:55.507356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4cda9-8217-4515-b1b9-4167794dd9ad None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:55.544956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:55.545633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.545911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.546213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.546930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:55.547233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:55.548589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:55.553947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 449/885] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:55.560329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:55.671160 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89a58-9dac-4fbc-9011-475e62e9403b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:55.707397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:55.708093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.708379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.708656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.709391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:55.709704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:55.711209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:55.718505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 437/886] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:55.724114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:55.741380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:55.839087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ba2bb-eef8-417d-8a34-fe9395302951 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:55.874527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:55.875203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.875491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.875773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.876569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] RBAC: Adding query filter params (interface=public, service_id=b52fb11d3d0e41ddaccd8f556f786e46, region_id=RegionOne) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:55.876883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:55.878286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe317f-f74b-456b-9998-0f9b88315e9e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:55.884285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 450/887] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:46:55 2022] GET /identity/v3/endpoints?service_id=b52fb11d3d0e41ddaccd8f556f786e46&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:55.890441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:55.900646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:55.921792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206940c4-fab4-4963-85f1-d0bdff87affb None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.922067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206940c4-fab4-4963-85f1-d0bdff87affb None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.922306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206940c4-fab4-4963-85f1-d0bdff87affb None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.924682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 451/888] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:55.929667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299b27-d354-4150-95a6-4bd029071e58 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:55.929963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299b27-d354-4150-95a6-4bd029071e58 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:55.930347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299b27-d354-4150-95a6-4bd029071e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:55.948004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d0299b27-d354-4150-95a6-4bd029071e58 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:55.949314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d0299b27-d354-4150-95a6-4bd029071e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:56.004702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c18a-1c0e-486f-aa61-d6e681ac16db None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.020835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 452/889] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:56.022265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52497-9137-4d4c-bb6a-e02ed54b1143 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.022558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52497-9137-4d4c-bb6a-e02ed54b1143 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.022836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede52497-9137-4d4c-bb6a-e02ed54b1143 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.026253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 453/890] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:56.029403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075780d9-507d-412b-88c6-63a14b90834b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.029850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075780d9-507d-412b-88c6-63a14b90834b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.030142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075780d9-507d-412b-88c6-63a14b90834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.043646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.046329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-075780d9-507d-412b-88c6-63a14b90834b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:56.047491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-075780d9-507d-412b-88c6-63a14b90834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:56.054962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.055633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.055920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.056201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.057452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.058870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.065433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 438/891] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:46:55 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:46:56.066175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.135991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 454/892] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:56.159173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075780d9-507d-412b-88c6-63a14b90834b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.171692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.210677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb647d-1dab-4bdb-8b19-8c725bd9b524 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.250737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.251952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.252471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.252751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.265773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:46:56.272330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075780d9-507d-412b-88c6-63a14b90834b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:46:56.274764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:56.275765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:56.276596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 439/893] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:56.282274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.320648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.321534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.321830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.323250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.323922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.325287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:56.341972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:56.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:56.343829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:46:56.346729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.346729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 455/894] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:56.354254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.419754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fae4c-ffaf-4db7-9c51-f8e2eecadb41 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.450849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.457593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.458787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.459394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.459896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.461016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:56.461428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.463565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.477916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 440/895] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:56.479733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.495107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1630-e092-429c-9945-1aed3aabc577 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.531237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.532102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.532484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.532862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.533726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:56.534243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.535712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.546138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 456/896] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:56.547640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.609035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3c7b-51b0-46fc-9fe9-574d92533f5a None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.628241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.660397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.662026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.662510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.663093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.669893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e4a8-a2a6-4196-8e04-ca03148b6d16 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.678185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.680214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:56.704192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:56.705322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:56.706443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:56.706443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:56.706443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:56.706443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:56.708137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.708544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 441/897] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:56.708968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.709353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.709704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.718686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:56.718686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.718686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.722678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 457/898] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:56.723109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.728657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.784192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.843267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532c216-ac74-41cd-8ac4-252ac277a010 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.854906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a66c8-2cac-49d9-8732-84b8e53f1ce9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:56.875670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:56.888198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.889148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.889438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.889709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.890636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] RBAC: Adding query filter params (interface=public, service_id=ce3df11027774150ae1272826945b585, region_id=RegionOne) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:56.891201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.893354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.900991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:56.901990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:56.902529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:56.903008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:56.904100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:56.904634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:56.905213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 458/899] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/endpoints?service_id=ce3df11027774150ae1272826945b585&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:56.906460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:56.906749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:56.922894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 442/900] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:56.928949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.025127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c526-14f1-4f3e-bab6-2aea92fe304b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.061794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.062484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.062814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.063092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.063780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.065262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.073273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 459/901] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 12:46:57.084919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dec21-a0ef-42e4-a55a-81198ac624f2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.088285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:57.132315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.133147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.133439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.133717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.142849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.144444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e1bd4551-7add-4726-ba92-788e2aaa4c67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:46:57.162006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:57.163079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:57.164300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 443/902] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:46:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:57.171821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.240322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:57.293875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da19b-0098-479d-ad1d-83af4af35286 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.294246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da19b-0098-479d-ad1d-83af4af35286 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.294366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a87a09-eb14-4c29-b93b-890290eb4dec None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.294542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da19b-0098-479d-ad1d-83af4af35286 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.295920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 444/903] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:57.302443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.303035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.303517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.327187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:57.328401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:57.341030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.341707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.341984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.342290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.343128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:57.343432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.344848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.368082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 460/904] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:46:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:57.374677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.426095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 445/905] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:46:57.450448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.503323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0d94-ae51-4148-8aac-af41d8480d7a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.522973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:57.542966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.543619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.543936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.544158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.573021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:57.583878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e883a0-464c-43e3-8155-7c82eec9c136 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.627785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.629244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.640294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.641836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.642356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.642839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.644266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.646604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.667594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 446/906] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:46:57 2022] POST /identity/v3/services => generated 241 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:57.758852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 461/907] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:46:57 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:46:57.765409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.883840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c3563-50c7-4c88-91d4-ecff2d06623e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:57.920081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:57.921221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:57.921722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:57.922208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:57.934799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:57.936532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:46:57.955559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:57.956485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:57.957366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:46:57.957366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:46:57.957366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:46:57.957366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:57.959358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 447/908] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:57.965113 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:57.981290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:58.073620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564520a-ca86-464b-b145-e25cb3d6cdf0 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.109484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.110451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.110875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.111291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.112149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:58.112655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.114239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.127228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 462/909] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:58.133046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:58.137498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:58.248636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112f4e-5e48-463a-b3af-82799ec522fa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.291030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.292157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.292594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.293018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.300663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.302329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8d114df9-3ebf-49c5-acc1-dbef9f21e525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:46:58.317993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:58.319144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:46:58.320210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:58.322670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 448/910] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:58.334151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:58.410415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:58.437962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6cabc-2927-4d57-b7f8-d49bf2e3d3e4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.452991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588823a3-eafc-40fe-b380-380925c2f31c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.453520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588823a3-eafc-40fe-b380-380925c2f31c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.453607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588823a3-eafc-40fe-b380-380925c2f31c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.455277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 449/911] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:46:58.463658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.464202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.464760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.472406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.473065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.473341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.473610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.474419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:58.474723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.476130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.484575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:58.486081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:58.489181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 463/912] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:58.495005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:58.550194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:58.570238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 450/913] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:58.589523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:58.596750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc677f18-8b78-4ba8-87b1-11de0d49ea8c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.632354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.633004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.633282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.633549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.634951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] RBAC: Adding query filter params (role.id=685119bda8b249a6ad16c4af0d17282d, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=7229ef6d88a04c57b7e83485be988aee) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:58.635355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.636836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.638838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:58.643829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 464/914] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/role_assignments?user.id=7229ef6d88a04c57b7e83485be988aee&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=685119bda8b249a6ad16c4af0d17282d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:46:58.704686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab033f-076b-4c47-a856-554782b5dcfd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.745320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.746456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.746917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.747357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.748216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.749802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:58.763351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:58.764632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 12:46:58.765692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:58.767769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 451/915] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:58.773801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:58.884097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9afbd-2b89-4ea6-bebf-e994e6589ba8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:58.925067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:58.925867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:58.926165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:58.926445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:58.927184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:58.927489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:58.928906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:58.936366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 465/916] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:58.942655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:59.005410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:59.059600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa8018-322d-4e90-8f4f-8b6d6f6771b0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:59.095443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:59.096116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.096399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.096674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.097396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:59.097704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:59.099132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2ac62-0abb-40d3-8fb0-400b92fb012c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:59.105622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 452/917] 10.222.0.36 () {56 vars in 1114 bytes} [Tue May 24 12:46:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:59.111435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:59.178915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:59.225657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c67ca-dc2a-4a1e-9f6d-afa573c204db None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:59.262652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:59.263234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.263514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.263785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.264528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:59.265877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbef3d7-3cdf-4726-bf89-bfddfcce25d5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:59.287972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 466/918] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:46:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:46:59.392807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bce73-5686-42fb-afd9-f70c38ee2160 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.393098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bce73-5686-42fb-afd9-f70c38ee2160 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.393371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bce73-5686-42fb-afd9-f70c38ee2160 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.395176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 453/919] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:46:59.401562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.401853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.402156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.425567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:46:59.427447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:46:59.519334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 467/920] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:46:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:46:59.545659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bce73-5686-42fb-afd9-f70c38ee2160 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:59.656241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bce73-5686-42fb-afd9-f70c38ee2160 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:59.677166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:59.692685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:59.694036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.694349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.694630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.695294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:59.696683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:46:59.709438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:46:59.710414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:46:59.711708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 454/921] 10.222.0.36 () {56 vars in 1132 bytes} [Tue May 24 12:46:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:46:59.717772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:46:59.766624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:46:59.827333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f82b2-3ea6-48a5-ac44-2ff8861f3854 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:46:59.871763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:46:59.872439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:46:59.872723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:46:59.873000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:46:59.873717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:46:59.874026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:46:59.875431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:46:59.881106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 468/922] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:46:59.887745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.005095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f35f-99c2-4a2b-b465-07d0082e8362 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.040462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.041903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.044500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.044500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.044500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:00.044500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.044784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c12ae6-88ba-4478-9064-2d75d0403aa0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.050431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 455/923] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:46:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:00.059194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.115134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef161-9187-4e8e-8480-12aac564a94c None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.115447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef161-9187-4e8e-8480-12aac564a94c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.115618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef161-9187-4e8e-8480-12aac564a94c None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.117271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 456/924] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:00.122517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c72d3-9252-478c-9386-389089ccedee None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.122802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c72d3-9252-478c-9386-389089ccedee None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.123084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c72d3-9252-478c-9386-389089ccedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.141412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-247c72d3-9252-478c-9386-389089ccedee None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:00.142698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-247c72d3-9252-478c-9386-389089ccedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:00.170494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46fe7-c2f4-4a93-b3b8-1287bf6cf6ec None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.180162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:00.193636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:00.210159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.210159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.210159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.210159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.210620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.210620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.224639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 457/925] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:00.231034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 469/926] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:47:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:00.248729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c72d3-9252-478c-9386-389089ccedee None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.364509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c72d3-9252-478c-9386-389089ccedee None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.410932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.411951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.412259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.412644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.413403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.415009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:00.428490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:00.429529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:00.430376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 458/927] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:47:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:00.436717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.561144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf199845-0821-4acf-9e7c-d073fba3aa7c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.601693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.602407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.602718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.602995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.603840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:00.604150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.605540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.611292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 470/928] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:00.616660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.662054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:00.729666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820550-7bd2-4af6-b0ff-c837e6c9a1bb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.766536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.767213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.767496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.767773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.768488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:00.768798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.770199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.776705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 459/929] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:00.782240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:00.811575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:00.891156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632063-34ef-4cb0-8388-5525cf9601d8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:00.934179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:00.934757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:00.935040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:00.935318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:00.936106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] RBAC: Adding query filter params (interface=public, service_id=eb4e7fa2ec144f128512c7c21a0896e9, region_id=RegionOne) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:00.936419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:00.937791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f963fb-d1d6-42e1-8a5c-773a2465b28e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:00.943460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 471/930] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:47:00 2022] GET /identity/v3/endpoints?service_id=eb4e7fa2ec144f128512c7c21a0896e9&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:00.948812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.060221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672264b-0932-440e-9442-7ac345ad2eaa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.061829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:01.090224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e531-e660-4b1e-b9a8-8d2c60067422 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.090563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e531-e660-4b1e-b9a8-8d2c60067422 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.090784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e531-e660-4b1e-b9a8-8d2c60067422 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.096269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 472/931] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:01.098372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.098654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.098937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.100503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:01.101335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.101784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.102249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.103223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:01.105949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:01.113595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 460/932] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:47:00 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:47:01.120602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:01.120602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:01.198917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 473/933] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:01.221853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.338798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5186b-185e-4104-b217-f34b6dead119 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.377468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:01.378330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.378618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.378898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.390034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:01.398360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:01.399292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:01.400838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 461/934] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:47:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:01.413068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.438413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:01.525612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e55e-f494-41ab-8ae3-85ff99daebe5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.566833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:01.567516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.567799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.568075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.568827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:01.569135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:01.570714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8e80a-da33-4883-a499-1bcc56a380b1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:01.580325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 474/935] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:01.587550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.616913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:01.695940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f56a-e9e2-482d-ba98-6f3c000f7724 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.696252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f56a-e9e2-482d-ba98-6f3c000f7724 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.696487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f56a-e9e2-482d-ba98-6f3c000f7724 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.698191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 475/936] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:01.703955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.703955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.703955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.706332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f723a7-1a27-4538-b466-3f723cca76db None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.722153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:01.723674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:01.748249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:01.749050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.749336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.749610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.762575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:01.764338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:01.783078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:01.783992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:01.784861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:01.784861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:01.784861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:01.784861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:01.787184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 462/937] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:01.795736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.805802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 476/938] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:01.829600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:01.844917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:01.891169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:01.915995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87bfea-431e-4741-8b35-ca097428a046 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.953598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:01.954347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:01.954635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:01.954912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:01.955701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:01.955962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c30c-c2ca-4266-a5ad-e3dc70de140e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:01.956085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:01.957387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:01.976079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 463/939] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:01.977794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.004629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.006441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.007203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.007688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.008809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.011085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.013389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING keystone.server.flask.common [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 24 12:47:02.037072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.sql.core [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 12:47:02.037072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 12:47:02.037072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [parameters: {'id': 'b63748db2b9d4df4a04a46df9bd92d9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 12:47:02.037072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63748db2b9d4df4a04a46df9bd92d9a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63748db2b9d4df4a04a46df9bd92d9a. May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application conn.query(q) May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:47:02.060466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application result.read() May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 24 12:47:02.061358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return project_ref.to_dict() May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application next(self.gen) May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application yield resource May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application next(self.gen) May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self.session.rollback() May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self.force_reraise() May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise self.value May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application session.commit() May 24 12:47:02.062301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._prepare_impl() May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self.session.flush() May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._flush(objects) May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application compat.raise_( May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application flush_context.execute() May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 12:47:02.063182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rec.execute(self) May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 12:47:02.065380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application conn.query(q) May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application result.read() May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:47:02.066193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [parameters: {'id': 'b63748db2b9d4df4a04a46df9bd92d9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.069597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:02.071770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.Conflict( May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b63748db2b9d4df4a04a46df9bd92d9a. May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 477/940] 10.222.0.36 () {60 vars in 1140 bytes} [Tue May 24 12:47:01 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:02.074599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.105574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b005-564e-4b5b-b34a-a9e9c2a75595 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.152665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.153071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.154338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.155652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.156120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.164487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.167275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.169782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:02.189844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:02.190867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:47:02.191783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:02.192312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288b88-b5f0-46c2-bc2d-ce1289a968a6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.200505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 464/941] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:47:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:02.202759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.233667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.235088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.235559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.236163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.245900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.248795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:02.267242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:02.268163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:02.269027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:02.271969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 478/942] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:02.277970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.320715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23549-5ee7-4cb5-bb4f-5a1c02374cde None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.363851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.364881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.365427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.365786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.367094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:02.367296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.368923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.394410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 465/943] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:02.395963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.419156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3ef8-90a2-4d87-b3e7-f497dfa3fcad None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.452942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.461887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.463202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.463491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.463765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.464556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:02.464865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.466599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.475560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.492120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 479/944] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:02.527621 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163c04-3254-4963-b596-48bf48c2b846 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.567723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.568792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.569249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.569676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.582060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.583826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-caab8949-1e85-458a-93a2-9154651f4de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:02.604537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:02.605696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:02.606824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:02.606824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:02.606824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:02.606824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:02.608855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 466/945] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:02.614425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.642501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-2fce-4e1b-9460-66d60abbde39 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.643562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-2fce-4e1b-9460-66d60abbde39 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.643999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd8f-2fce-4e1b-9460-66d60abbde39 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.646764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 467/946] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:02.653177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.653878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.654356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.677364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:02.679326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:02.743231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce1d2-92b8-4e65-a840-05aa0e15c383 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.771927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 468/947] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:02.784701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.785375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.785658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.785935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.786948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:02.787054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.788383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.795415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.800922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 480/948] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:02.807924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.839526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.863511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:02.907680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4df3a-ba43-4f42-bca9-0fc70d51ebdf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.936269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4612-6628-49a8-9036-fca6c5c44532 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:02.948002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.948907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.949196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.949474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:02.950174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:02.952105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:02.967641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:02.968695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:02.969955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:02.974140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 469/949] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:02.975209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:02.991416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:02.993380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:02.994024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:02.994536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.004764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.007569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:03.034775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:03.035712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:03.036581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:03.040016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 481/950] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:03.046406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:03.094508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf587a-d833-4e4d-86e1-f5ca0f24cbc9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:03.096253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:03.132362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:03.133129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.133516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.134091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.135631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:03.135951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.137382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.148459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 470/951] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:03.149385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:03.180435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06de4db-d2d0-4045-8a23-78028258ef34 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:03.192365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:03.218950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:03.219613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.219898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.220177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.220966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:03.221277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.222761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.240026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 482/952] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:03.241359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:03.286434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be350d-47dd-4012-84f7-868d60150632 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:03.322725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:03.323423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.323709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.323987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.324701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] RBAC: Adding query filter params (type=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:03.325013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.326465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d538d-265d-430e-965f-16ff5ed867ac None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.338467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 471/953] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:03.375674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380a0e8-2e58-4295-b160-644c67974cd3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:03.422332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:03.423736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.424247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.424782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/7229ef6d88a04c57b7e83485be988aee/roles/685119bda8b249a6ad16c4af0d17282d` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.427540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=7229ef6d88a04c57b7e83485be988aee, role_id=685119bda8b249a6ad16c4af0d17282d)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.429284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb21976-94c4-4d2a-b650-4e4ff15eacbf None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.447992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 483/954] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:47:03 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/7229ef6d88a04c57b7e83485be988aee/roles/685119bda8b249a6ad16c4af0d17282d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:47:03.547772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dff2-7ca7-4976-9489-86bd21c459d8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.548112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dff2-7ca7-4976-9489-86bd21c459d8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.548372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248dff2-7ca7-4976-9489-86bd21c459d8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.550177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 472/955] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:03.555690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.555992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.556840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.574914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:03.576489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:03.602699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:03.654922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 484/956] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:03.678170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248dff2-7ca7-4976-9489-86bd21c459d8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:03.710426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:03.793273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248dff2-7ca7-4976-9489-86bd21c459d8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:03.829297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:03.830422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:03.830857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:03.831372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:03.832181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:03.833846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:03.847399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:03.848735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:03.849834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:03.852559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 473/957] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:47:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:03.858409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:03.966897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca536-0199-4e35-a933-d1d5ae97a4ac None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:04.002687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:04.003364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:04.003650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:04.003928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:04.004642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:04.004952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:04.006616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:04.012034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 485/958] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:04.019559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:04.122249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449598b-9bab-4521-af10-4c00c69ab32b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:04.126523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:04.159548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:04.160220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:04.160505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:04.160784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:04.161493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:04.161803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:04.163220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc80ba-f104-4ce6-b34a-9d570194af41 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:04.170890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 474/959] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:04.183640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:04.210983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:04.289792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4662-681d-47f0-97a0-28866442e281 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:04.325846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:04.326547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:04.326833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:04.327115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:04.327860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:04.329228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65d5c8-f9cd-414e-8384-3be7ff706637 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:04.351184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 486/960] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:47:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:04.909033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724edb4-0eb0-4dbc-97b7-eb04d5d10b29 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:04.909551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724edb4-0eb0-4dbc-97b7-eb04d5d10b29 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:04.909551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724edb4-0eb0-4dbc-97b7-eb04d5d10b29 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:04.911283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 475/961] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:04.916717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732447ed-6542-4e60-989d-da9e37090860 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:04.917158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732447ed-6542-4e60-989d-da9e37090860 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:04.917338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732447ed-6542-4e60-989d-da9e37090860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:04.934870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-732447ed-6542-4e60-989d-da9e37090860 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:04.936061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-732447ed-6542-4e60-989d-da9e37090860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:05.010855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 487/962] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:05.045215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724edb4-0eb0-4dbc-97b7-eb04d5d10b29 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:05.158809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724edb4-0eb0-4dbc-97b7-eb04d5d10b29 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:05.196058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:05.197265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.197832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.198358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.199277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:05.200958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:05.202505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING keystone.server.flask.common [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 24 12:47:05.216059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.sql.core [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 12:47:05.216059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 12:47:05.216059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [parameters: {'user_id': '146389be07df4ce5b9c85d35635f27d1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 12:47:05.216059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80162) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 24 12:47:05.224581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:47:05.225468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application yield resource May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application next(self.gen) May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.rollback() May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.force_reraise() May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise self.value May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application session.commit() May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 12:47:05.226585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._prepare_impl() May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.session.flush() May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._flush(objects) May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application compat.raise_( May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application flush_context.execute() May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rec.execute(self) May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 12:47:05.227465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = connection._execute_20( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 12:47:05.229828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result = self._query(query) May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application conn.query(q) May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application result.read() May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 12:47:05.231877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [parameters: {'user_id': '146389be07df4ce5b9c85d35635f27d1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:05.233983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 24 12:47:05.235897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 12:47:05.238971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:05.241154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 476/963] 10.222.0.36 () {60 vars in 1131 bytes} [Tue May 24 12:47:05 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:05.246609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732447ed-6542-4e60-989d-da9e37090860 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:05.274424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:05.356396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732447ed-6542-4e60-989d-da9e37090860 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:05.392790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:05.393593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.393872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.394171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.401765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:05.403291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-445e0080-87a3-4237-b7fd-a4d078949f5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:05.418930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:05.419949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:05.421179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 488/964] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:05.426036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:05.454519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:05.544893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df21fda-b5c5-436d-b188-bd08639980a8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:05.579952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:05.580630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.580914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.581191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.582002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:05.582336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:05.583999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7feef5-3d99-48d3-9502-536e484367e5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:05.624665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 477/965] 10.222.0.36 () {56 vars in 1101 bytes} [Tue May 24 12:47:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:05.682018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c61-5757-4ac9-b86f-f09deda2aea7 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.682373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c61-5757-4ac9-b86f-f09deda2aea7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.682690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c61-5757-4ac9-b86f-f09deda2aea7 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.684470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 489/966] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:05.690687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192b16-166b-43c0-bfe5-59ff1b72b676 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.691029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192b16-166b-43c0-bfe5-59ff1b72b676 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.691262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51192b16-166b-43c0-bfe5-59ff1b72b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.710905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-51192b16-166b-43c0-bfe5-59ff1b72b676 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:05.712957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-51192b16-166b-43c0-bfe5-59ff1b72b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:05.790197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 478/967] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:05.813387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea2c61-5757-4ac9-b86f-f09deda2aea7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:05.881438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee5cf-7ed1-4306-890e-0580a7121e2d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.881754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee5cf-7ed1-4306-890e-0580a7121e2d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.882011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee5cf-7ed1-4306-890e-0580a7121e2d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.883612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 479/968] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:05.885925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:05.889683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.889974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.890347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.910359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:05.910978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:05.913005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:05.931608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea2c61-5757-4ac9-b86f-f09deda2aea7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:05.969517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:05.970546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:05.971000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:05.971442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:05.972371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:05.973939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:05.986399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 480/969] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:05.990374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 490/970] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:47:05 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:06.011835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.124222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eed9b-b268-4bb1-a41c-029d960a59c0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.170939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.171496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.171784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.172063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.174345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:06.187701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:06.195992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:06.197013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:06.198132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 481/971] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:06.204949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.311171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310bf5f-fb5a-423b-a5f4-4939dccc385b None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.336440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:06.347870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.348544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.348828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.349103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.349850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:06.350180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:06.351543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:06.365186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 491/972] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:06.366830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.479736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c41364-aa2f-473d-a8ad-3b8c920f6eb9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.515508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.515508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.515508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.515508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.528290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:06.529747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0c6428a7-a598-469f-9fbe-cee883f9f04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:06.547265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:06.548176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:06.549065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:06.549065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:06.549065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:06.549065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:06.549065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 482/973] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:06.555364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.620105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f5b0-2cf2-45cf-a79b-6e0106180300 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.620390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f5b0-2cf2-45cf-a79b-6e0106180300 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.620585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f5b0-2cf2-45cf-a79b-6e0106180300 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.622298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 483/974] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:06.627440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.627737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.628018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.647779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:06.648965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:06.664382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f758e8-801b-413c-b3ac-e22f78c452bd None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.700316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:06.701299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.701976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.702293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.702649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.703396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:06.703949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:06.705530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:06.722895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 492/975] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:06.723912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.732407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 484/976] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:06.755260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.776004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:06.832588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3741-5e52-4554-abe5-f41beb7e4142 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.864793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11354c-8f5f-4d21-8ce6-c9b3bec9a911 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:06.874599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.875347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.875825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.875935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.883346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:06.884967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:06.900436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:06.901454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 12:47:06.902408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:06.902957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:06.902957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:06.902957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:06.902957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:06.903223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:06.904144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:06.906461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 493/977] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:06.907290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:06.918908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:06.920201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:06.921030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 485/978] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:06.925963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:06.969817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.018993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa41e-8142-4b78-ac25-1b40a7f27808 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.029243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.036749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3c42a-47af-4adf-b6c4-4214107d8e1e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.066106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.066889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.067178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.067457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.068288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:07.068598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.070012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.072831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.073503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.073790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.074067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.074824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:07.075135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.076502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.086444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 486/979] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:07.088168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.095331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 494/980] 10.222.0.36 () {56 vars in 1149 bytes} [Tue May 24 12:47:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:07.097466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.209964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17265272-328a-420a-b8b6-55e3a9894828 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.213826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.216396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536f77-0b3d-49aa-984e-32bf13551665 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.251399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.251766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.252054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.252336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.252434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.252610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.252708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.252936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.253647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:07.253939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.255601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.261991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 487/981] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:07.267879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.291014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.329474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.331064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.373527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac8692-caea-45c6-aa27-830957a0b8ee None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.414009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.414700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.414981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.415756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.416867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] RBAC: Adding query filter params (interface=admin, service_id=eb4e7fa2ec144f128512c7c21a0896e9, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:07.416867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.418248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.424107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 488/982] 10.222.0.36 () {56 vars in 1249 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/endpoints?service_id=eb4e7fa2ec144f128512c7c21a0896e9&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:07.429202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.448243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 495/983] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 12:47:07.449183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.464138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.528786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.537729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b5543-ac1c-4b1a-9697-202030b320af None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.569934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f934-6b70-4d69-bbc1-b2c78f319bae None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.573081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.573744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.574044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.574351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.575026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.576402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.582903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 489/984] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 12:47:07.610040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.611268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.611808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.612268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.625773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.627652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:07.648796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:07.649752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:07.651334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:07.651334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:07.651334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:07.651334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:07.652333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 496/985] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:07.658072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.764573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.773393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b93f0-ffff-42d2-add0-e3359c84664e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.809790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.810526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.810814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.811094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.811824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:07.812137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.813518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.830191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 490/986] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:07.831569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:07.938154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd28ca-982f-48f3-a24a-91f83d623972 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:07.955563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:07.973888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:07.974724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:07.975008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:07.975283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:07.983273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:07.984719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:07.998523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:07.999490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:08.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 497/987] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:08.005676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.113339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78073c-7d78-4f8a-8616-cabec39b88d8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:08.149229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:08.149923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.150234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.150513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.151300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:08.151614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:08.153048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6353a7-a1c8-4879-b719-07a256339480 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:08.170930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 491/988] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:08.172212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.271745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aad97-7620-46ad-a249-007d1033a3c2 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.272114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aad97-7620-46ad-a249-007d1033a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.272311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aad97-7620-46ad-a249-007d1033a3c2 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.273846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 492/989] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:08.276471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a6a22-1534-4249-aba4-e7e98ec31d9c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:08.279323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.279611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.279889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.297276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:08.298498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:08.309932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:08.316000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:08.316662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.316942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.317216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.318050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] RBAC: Adding query filter params (role.id=685119bda8b249a6ad16c4af0d17282d, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=7229ef6d88a04c57b7e83485be988aee) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:08.318409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:08.319838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:08.327139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 498/990] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/role_assignments?user.id=7229ef6d88a04c57b7e83485be988aee&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=685119bda8b249a6ad16c4af0d17282d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:08.383824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 493/991] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:08.410143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.455871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:08.521030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416cad6-2408-4261-8d1b-8795cfbd9ef0 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:08.558254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:08.559050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.559330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.559601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.560251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:08.561598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:08.575081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:08.576102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:08.576939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 499/992] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:08.582432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.685756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d1642-e495-4f64-8e30-b32aae73c052 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:08.722504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:08.723186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.723469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.723743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.724454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:08.724758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:08.726150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:08.736782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 494/993] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:08.739207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.841307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a5f7e-3dca-4408-9d4d-db282f793388 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:08.848534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:08.876861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:08.877533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:08.877819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:08.878097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:08.878832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:08.879195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:08.880816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:08.886073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 500/994] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:08.891564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:08.904493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:08.995418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7420-f0ca-4a9e-b05e-29d08d1d9e27 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:09.030340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:09.031053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:09.031322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:09.031597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:09.032434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] RBAC: Adding query filter params (interface=public, service_id=b5de5d6265bd44e6ae689157a0bb27cc, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:09.032750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:09.034140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac7d7-5cd0-4e3b-aa11-48acf41e5f2d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:09.039361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 495/995] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:47:08 2022] GET /identity/v3/endpoints?service_id=b5de5d6265bd44e6ae689157a0bb27cc&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:09.045152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:09.155195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc284a4-b822-4b46-a7a1-e039e74fc569 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:09.197471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:09.198235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:09.198508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:09.198785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:09.199524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:09.200893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97734759-7bd8-44f8-bb7a-4f4480bdaeba None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:09.207768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 501/996] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:47:09 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:47:09.842019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814534-f2df-4112-814c-c24c76e8286b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:09.842428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814534-f2df-4112-814c-c24c76e8286b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:09.842616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814534-f2df-4112-814c-c24c76e8286b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:09.844179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 496/997] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:09.849225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:09.849528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:09.849818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:09.867364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:09.869205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:09.897642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:09.941408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 502/998] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:09.964895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814534-f2df-4112-814c-c24c76e8286b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.045351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:10.075342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814534-f2df-4112-814c-c24c76e8286b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:10.110501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:10.111227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.111527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.111789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.112440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:10.113818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:10.126526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:10.127519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 12:47:10.128356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.130694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 497/999] 10.222.0.36 () {56 vars in 1126 bytes} [Tue May 24 12:47:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:10.135174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.237985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d9a3-f2fc-436c-8721-7286cd772c15 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:10.273401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:10.274071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.274378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.275726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.276436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:10.276741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:10.278095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:10.287657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 503/1000] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:10.288444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.401685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03a14-1821-493c-b1f7-ee3a69be8029 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:10.439425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:10.440110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.440391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.440665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.441387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:10.441695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:10.443172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5590-ba08-43cc-ac73-c014ea27ee9e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:10.449785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 498/1001] 10.222.0.36 () {56 vars in 1122 bytes} [Tue May 24 12:47:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:10.455324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.485866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:10.561406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3cb72-e475-4c8f-b6b3-3ca5263b4b47 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:10.595561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:10.596219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.596503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.596777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.597519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:10.598911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc058e-0e19-4fd1-b92c-f548b99f09aa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:10.613448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea956-a4bf-4c75-9105-7020353e2e84 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.614052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea956-a4bf-4c75-9105-7020353e2e84 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.614188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 504/1002] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:47:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:10.614681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ea956-a4bf-4c75-9105-7020353e2e84 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.616310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 499/1003] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:10.622550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.622845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.623110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.641793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:10.643102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:10.724790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 505/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:10.747270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ea956-a4bf-4c75-9105-7020353e2e84 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.750366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:10.856820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ea956-a4bf-4c75-9105-7020353e2e84 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:10.892025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:10.892816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:10.893101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:10.893374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:10.894028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:10.895469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:10.907360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:10.908346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:10.909172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 500/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 24 12:47:10 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:10.914765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:10.930053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:11.019010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a209699-bc87-4d59-80bd-7e4312151567 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:11.053371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:11.054044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.054356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.054638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.055349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:11.056174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:11.057553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6803bb-4b59-49b3-9e12-7d40e7d01ff3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:11.062713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 506/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:11.068150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:11.138431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:11.177171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bc8b-2e6a-4456-b229-f4507ad68fe9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:11.212488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:11.212914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.213203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.213482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.214219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] RBAC: Adding query filter params (type=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:11.214533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:11.215911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6236-c879-45e1-96a3-5875ad3bd704 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:11.226414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 501/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:11.442810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c560b-7667-4814-b3b1-be1125a67e2e None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.443338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c560b-7667-4814-b3b1-be1125a67e2e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.443338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c560b-7667-4814-b3b1-be1125a67e2e None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.444910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 507/1008] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:11.450664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.450959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.451244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.468142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:11.469335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:11.539793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 502/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:11.562526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c560b-7667-4814-b3b1-be1125a67e2e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:11.643144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:11.666760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c560b-7667-4814-b3b1-be1125a67e2e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:11.701633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:11.702463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.702753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.703032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.703752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:11.705163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:11.717268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:11.718351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:11.719182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 508/1010] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:11.724705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:11.787630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:11.833113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1041c0-abf4-418e-8184-b4e24f28fe33 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:11.869072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:11.869835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:11.870225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:11.870577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:11.871366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:11.871751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:11.873208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:11.883131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 503/1011] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:11.885438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:11.987404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca202-24ce-4df8-94f0-e8f5fc9dbdf4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:12.021533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:12.022377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:12.022763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:12.023142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:12.023953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:12.024987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:12.026447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bae69-d7b4-49ca-8c86-dbae2420164f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:12.035947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 509/1012] 10.222.0.36 () {56 vars in 1112 bytes} [Tue May 24 12:47:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:12.037133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:12.137948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1861-9e6b-4ff8-a474-2617fa5572b1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:12.162061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:12.173472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:12.174146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:12.174430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:12.174704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:12.175443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:12.176810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc97e7d-a359-4410-a173-77a0657f2833 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:12.206145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 504/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:47:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:12.862955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4064-c04a-4e0a-9057-6efcf6fbee6b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:12.863473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4064-c04a-4e0a-9057-6efcf6fbee6b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:12.863553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c4064-c04a-4e0a-9057-6efcf6fbee6b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:12.865067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 510/1014] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:12.870192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:12.870489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:12.870770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:12.888680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:12.889877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:12.965019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 505/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:12.988375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c4064-c04a-4e0a-9057-6efcf6fbee6b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:12.998695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:13.096989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c4064-c04a-4e0a-9057-6efcf6fbee6b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:13.132706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:13.133428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:13.133819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:13.134096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:13.135503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:13.136933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643fe26-be5f-4aa8-8ebf-42b615391008 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:13.143523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 511/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:13.144758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:13.247617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad66a36-7737-4ab0-8150-02b86263bbd0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:13.255722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:13.289491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:13.290846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:13.291138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:13.291417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:13.292147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:13.293629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbd6c-4e40-4ded-9a2e-e50ffa131dd6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:13.326140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 506/1017] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:47:13 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:13.467935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b477-4c62-42f0-9629-131e692d384f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:13.468223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b477-4c62-42f0-9629-131e692d384f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:13.468507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b477-4c62-42f0-9629-131e692d384f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:13.469933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 512/1018] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:13.475616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f693-2508-43a4-80e2-ff3d1a74bc94 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:13.475912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f693-2508-43a4-80e2-ff3d1a74bc94 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:13.476190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f693-2508-43a4-80e2-ff3d1a74bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:13.494758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-19e7f693-2508-43a4-80e2-ff3d1a74bc94 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:13.495970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-19e7f693-2508-43a4-80e2-ff3d1a74bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:13.573282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 507/1019] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:13 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:13.596670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452b477-4c62-42f0-9629-131e692d384f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:13.675254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:13.703420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452b477-4c62-42f0-9629-131e692d384f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:13.737095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:13.737759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:13.738044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:13.738351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:13.739070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:13.740420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed3d4a-507e-446d-a444-faef44aa1010 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:13.755406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 513/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:47:13 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:14.577485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840a93-0dc4-4bdb-a62b-3ac43d2a68e6 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:14.578032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840a93-0dc4-4bdb-a62b-3ac43d2a68e6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:14.578032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840a93-0dc4-4bdb-a62b-3ac43d2a68e6 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:14.579616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 508/1021] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:14.584785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:14.585188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:14.585366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:14.604290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:14.605464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:14.679449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 514/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:14.703099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5840a93-0dc4-4bdb-a62b-3ac43d2a68e6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:14.793781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:14.809282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5840a93-0dc4-4bdb-a62b-3ac43d2a68e6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:14.844995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:14.845798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:14.846077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:14.846379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:14.857059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:14.865356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:14.866506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:14.867368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:14.870430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 509/1023] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:47:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:14.873147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:14.940692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:14.983853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b31da2-6ab2-4dfb-8af4-59aad91a7d6a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.019577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.020252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.020536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.020814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.021566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:15.021875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.023269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.032479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 515/1024] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:15.039357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.145422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0c28-4b4f-41c5-91db-5c84254586e9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.180306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.181784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.182080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.182383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.193933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.195363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.204185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:15.215179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:15.216086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:15.221510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:15.221510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:15.221510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:15.221510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:15.221510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 510/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:15.223300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.326044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211249-5bda-4a4a-b705-95f303be4dac None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.348395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:15.360910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.361577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.361857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.362153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.362880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:15.363186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.364542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.385436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 516/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:15.386876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.498463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29f5f7-abe4-47ca-aa5e-831214594c92 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.532552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.533348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.533625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.533904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.541839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.543328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-88c21b62-289f-4f95-a9ab-e0e61d3806a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:15.557843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:15.558974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:15.564528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 511/1027] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:15.565134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.612337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325ee-d062-4929-afb8-f421bd1174e9 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.612884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325ee-d062-4929-afb8-f421bd1174e9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.613016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325ee-d062-4929-afb8-f421bd1174e9 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.614477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 512/1028] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:15.620926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.621214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.621488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.639543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:15.640735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:15.679818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247067-ad86-4529-8bbb-2a7b9cb80e29 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.699731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:15.712465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 513/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:15.722136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.722136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.722136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.722136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.722547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:15.722547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.722547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.738069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.744041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 517/1030] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:15.745036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.788795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:15.852791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185b3e-d96a-47a1-be85-65e33970e4c4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.853874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da50fa-0f15-45e9-ac1a-d3848562eb27 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:15.895451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.895666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:15.896104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.896281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:15.896377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.896523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:15.896671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.896818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:15.897965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.900179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:15.901908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 514/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:15.907578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:15.968051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:15.973111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:15.974634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.016280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75489465-4991-4b04-b985-2e033bc9678b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.017539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.052563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.053142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.053420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.053691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.054427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.056956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180b16-892e-4437-8a5e-a4ba78f6afd0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.077693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 515/1032] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:47:15 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:47:16.079038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77825af-e03f-4b4f-b1b1-6c8ee1fcb739 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.079331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77825af-e03f-4b4f-b1b1-6c8ee1fcb739 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.079623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77825af-e03f-4b4f-b1b1-6c8ee1fcb739 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.080913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 516/1033] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:16.086803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.087099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.087381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.097066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 518/1034] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 12:47:16.100003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.109727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:16.111025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:16.191610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 517/1035] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:16.216036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.217604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399f29-6ebd-4101-81e7-020e3cfcfb74 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.258007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.259490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.259779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.260051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.268364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.270543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.272479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.274190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:16.292528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:16.293479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:16.294398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:16.294398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:16.294398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:16.294398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:16.294398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 519/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:16.299488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.341408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb205c-14c7-4934-924c-01f9cb909e84 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.386411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.387213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.387496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.387775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] PATH_INFO: `/v3/services/image` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.388435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.390280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:16.405081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:16.406425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:16.407766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 518/1037] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:16.412241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.420749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335bbda-8dbb-4e7a-8ff9-047c1841a4b6 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.458557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.459217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.459496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.459768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.460490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.460809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.462817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.475226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 520/1038] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:16.481298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.530208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457eed-f274-4ea7-b48a-169f99417c06 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.536467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.540322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.567453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.568123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.568412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.568692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.569400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] RBAC: Adding query filter params (name=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.569707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.571293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.576307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 519/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:16.581822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.597078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c103d56-52fe-432e-be7e-5e4446931714 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.636407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.637544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.637544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.637758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.645697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.647208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:16.662199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:16.663126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:16.664110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 521/1040] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:16.669743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.693170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12010632-9868-40d2-8530-ceb922b3b59e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.730773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.731445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.731730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.732413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.733145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] RBAC: Adding query filter params (type=image) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.733613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.735021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.740393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 520/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:16.746192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.780511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cece8b3-189c-4af0-b0dd-89d115dc1356 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.790530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.794554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:16.817799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.818779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.819260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.819537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.820337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.820650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.822445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.834439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 522/1042] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:16.840775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.865716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78393725-b8f3-4700-8664-8e044b533f33 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.901772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.902461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.902747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.903022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.903806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] RBAC: Adding query filter params (interface=public, service_id=25402b7c427f4f5a93de5de1ff35ed1b, region_id=RegionOne) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.904121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.905497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.910822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 521/1043] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/endpoints?service_id=25402b7c427f4f5a93de5de1ff35ed1b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:16.917290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:16.952116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a618b-c807-416a-81d1-ac138d6bffd0 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:16.988121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:16.989031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:16.989314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:16.989598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:16.990461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] RBAC: Adding query filter params (role.id=685119bda8b249a6ad16c4af0d17282d, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:16.990778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:16.992201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04150586-f0a3-485b-b45a-9b297ec05db3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:16.998208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 523/1044] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=685119bda8b249a6ad16c4af0d17282d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:17.022915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:17.027927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738ccd7-da5a-4dc9-a93d-5d943d2472f0 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:17.066012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:17.066731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:17.067013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:17.067286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:17.067981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:17.069390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb15c0-b03a-4ca7-8ce5-bd7395002120 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:17.086182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 522/1045] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:47:16 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:47:18.390766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299a73-5fb7-400d-a44d-cea994de10a8 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:18.391279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299a73-5fb7-400d-a44d-cea994de10a8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:18.391357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299a73-5fb7-400d-a44d-cea994de10a8 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:18.392897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 524/1046] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:18.397868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:18.398271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:18.398481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:18.416758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:18.417947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:18.486772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 523/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:18.509862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299a73-5fb7-400d-a44d-cea994de10a8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:18.551437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:18.619288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299a73-5fb7-400d-a44d-cea994de10a8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:18.653983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:18.654723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:18.655011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:18.655285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:18.665981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:18.673573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:18.674785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:18.676017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 525/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:18.683368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:18.781643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:18.789348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159422ae-14f2-4dc1-8ce2-fe0632aed266 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:18.824877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:18.825555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:18.825838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:18.826135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:18.826890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:18.827197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:18.828580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:18.837655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 524/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:18.843128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:18.940493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:18.947678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802a23-4d3a-4fc2-bc0d-d009d9a4a900 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:18.984469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:18.985341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:18.985620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:18.985895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] PATH_INFO: `/v3/users/336b2a9e09e3463b8bf6d800241dedbb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:18.999424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] RBAC: Authorizing `identity:get_user(user_id=336b2a9e09e3463b8bf6d800241dedbb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.000852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8482ed2-1648-4a9a-8c28-8916d9bc1911 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.006474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 526/1050] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:18 2022] GET /identity/v3/users/336b2a9e09e3463b8bf6d800241dedbb => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:19.008698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.115144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4303-ffee-441b-9cb7-2cad092de88b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.159601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.160354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.160671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.160975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.190707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.235803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.237272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b930-5bb4-4ef1-b370-fbabf5f3608f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.255087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54359d6-d098-487f-954a-0e5ed99a1fa7 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.255394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54359d6-d098-487f-954a-0e5ed99a1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.255675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54359d6-d098-487f-954a-0e5ed99a1fa7 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.257071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 527/1051] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:19.263450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c899-994e-476d-ba43-7d1cd6e4be19 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.263730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c899-994e-476d-ba43-7d1cd6e4be19 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.264004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c899-994e-476d-ba43-7d1cd6e4be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.281536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1044c899-994e-476d-ba43-7d1cd6e4be19 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:19.283112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1044c899-994e-476d-ba43-7d1cd6e4be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:19.353785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 525/1052] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:19.353785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5644d6-582c-43b1-9030-89a0a56f3612 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.353785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5644d6-582c-43b1-9030-89a0a56f3612 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.353785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5644d6-582c-43b1-9030-89a0a56f3612 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.353785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 526/1053] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:19.355439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5644d6-582c-43b1-9030-89a0a56f3612 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.357354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:19.358868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.359160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.360295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.383709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:19.385122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:19.420001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.455154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 529/1055] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:19.456560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.467981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5644d6-582c-43b1-9030-89a0a56f3612 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.475418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.505329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.506215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.506508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.506791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.507968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.509638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.511426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 527/1056] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:19.512186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.566028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4acd93-b6a2-4726-b8f6-855921c5c5e4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.600307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.601119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.601412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.601687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.609515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912d19d-fdd9-4716-aab2-0c6701be36f6 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.612439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:19.621254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:19.622230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:19.623094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 530/1057] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:19.623764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.637641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.649419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.650079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.650390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.650678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] PATH_INFO: `/v3/services/image` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.651336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.652710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:19.664074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:19.666006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:19.666875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 528/1058] 10.222.0.36 () {56 vars in 1105 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:19.667855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.704252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.730170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9bae2-1b86-4f47-a690-205c53219d81 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.763045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.763698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.763983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.764260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.765081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854, user.id=336b2a9e09e3463b8bf6d800241dedbb) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:19.765390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.766849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.767591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f290-3e69-49fb-a7ed-6faa9059bb6b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.772255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 531/1059] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/role_assignments?user.id=336b2a9e09e3463b8bf6d800241dedbb&scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:19.773033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.814623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.815320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.815650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.815875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.816643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:19.816953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.818405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.834465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 529/1060] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:19.835699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.893825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.895393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9c2f-d0d2-411f-980a-6bd28a63c258 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.933832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.934658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.934943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.935330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:19.936058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:19.936368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:19.937772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:19.949030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 532/1061] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:19.949886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:19.953180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:19.958357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb1c9-8c71-4832-95ff-d3dbaba51e94 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:19.996985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:19.997702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:19.998149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:19.998475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.010891 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.012510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:20.030724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:20.031654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:20.032549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:20.032549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:20.032549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:20.032549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:20.032549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 530/1062] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:20.037403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.061720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3d272-05a7-438f-82f1-0d0d671104f2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.097978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.098821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.099095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.099379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.100086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] RBAC: Adding query filter params (type=image) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:20.100392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.101767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.107774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 533/1063] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:20.113361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.144115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c9d4-53a5-4b97-aa3d-b2af6f41f7bb None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.145739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:20.179750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.180664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.181233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.181513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.182355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:20.182646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.184027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.189204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:20.201796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 531/1064] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:20.202640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.233110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594ef85-74da-4a11-a976-e7eff58b0c7f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.282888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.285001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.285532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.286011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.286997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.288556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.318197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 534/1065] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:47:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:47:20.322978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4af1-577d-48b2-979c-87925f175826 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.392146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.393220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.393747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.394247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.403735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.405893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:20.424446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:20.426092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:20.427049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:20.429775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 532/1066] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:20.436901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.560362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43274c9-00bc-475b-b8b6-c70d6513adf3 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.584553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:20.601715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.603075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.603361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.603638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.604491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:20.604803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.606274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.630644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 535/1067] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:20.637880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.668603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:20.753872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1e87-5e44-46e5-8bdc-9b3ee9f0f295 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.790223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.791017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.791300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.791572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.801641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.803130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:20.820603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:20.822173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:20.823108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:20.823108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:20.823108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:20.823108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:20.826191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 533/1068] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:20.828256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:20.933758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cd6b5-bcaa-4331-a9a4-37845a53fa30 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:20.969690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:20.970383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:20.970664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:20.970934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:20.971653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:20.971955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:20.973307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:20.989975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 536/1069] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:20.991251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:21.063609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:21.096944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc3dd7-6e87-437d-a6d9-2a1a60351b6b None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:21.131457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:21.132246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:21.132532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:21.132810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:21.139739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:21.141194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:21.155890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:21.156828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:21.157720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:21.158774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 534/1070] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:21.162854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:21.208448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:21.268577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b96bc-df46-4bf7-916f-c1ce4e7dffbf None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:21.302909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:21.303576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:21.303861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:21.304137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:21.304931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:21.305794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:21.307251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be44-4bd9-48c1-bf22-f83251da862a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:21.324448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 537/1071] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:21.325655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:21.434417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b3a76-25ef-40ce-a1a5-26b85edae81f None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:21.463786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:21.471072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:21.471972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:21.472258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:21.472534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/685119bda8b249a6ad16c4af0d17282d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:21.474859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=0532ebb4e77b41179663accaa80e4942, role_id=685119bda8b249a6ad16c4af0d17282d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:21.476309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c89884-654e-4c6b-9c07-93f7fc25e1ee None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:21.491252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 535/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:47:21 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/0532ebb4e77b41179663accaa80e4942/roles/685119bda8b249a6ad16c4af0d17282d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:47:22.012229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310865-771a-404e-95b6-d717d1ce7a38 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.012782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310865-771a-404e-95b6-d717d1ce7a38 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.012782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310865-771a-404e-95b6-d717d1ce7a38 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.014249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 538/1073] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:22.019417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.019713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.019993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.037570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:22.038789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:22.106198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 536/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:22.130174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310865-771a-404e-95b6-d717d1ce7a38 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.233608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:22.239217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310865-771a-404e-95b6-d717d1ce7a38 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.273494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.274754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.275047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.275314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.285792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:22.294082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:22.294994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:22.295800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:22.297004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 539/1075] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:22.301318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.409630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbf1b6-7554-4f2e-9368-3a849f08faeb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.431331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:22.447338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.448114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.448320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.448602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.449378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:22.449692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:22.451189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:22.461175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 537/1076] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:22.467328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.570096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0087-a203-4df3-b54f-17ed3f0ca8ec None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.606937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.607823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.608115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.608393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] PATH_INFO: `/v3/users/336b2a9e09e3463b8bf6d800241dedbb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.609583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] RBAC: Authorizing `identity:get_user(user_id=336b2a9e09e3463b8bf6d800241dedbb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:22.611054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd2df-efed-4316-9d7f-7ec69b5b4d8a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:22.612887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 540/1077] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:22 2022] GET /identity/v3/users/336b2a9e09e3463b8bf6d800241dedbb => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:22.618444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.660705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb72b7-ca28-4bb1-989e-5c4235697b90 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.661057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb72b7-ca28-4bb1-989e-5c4235697b90 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.661267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb72b7-ca28-4bb1-989e-5c4235697b90 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.662827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 541/1078] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:22.668517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.668656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.668809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.687148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:22.688111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:22.716396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:22.729892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25238bf5-c88a-417b-8c7b-7d6a612b20c1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.764014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.765101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.765390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 542/1079] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:22.765694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.766153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.767557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:22.769126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:22.771026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 538/1080] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:22 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:22.777276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.792516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:22.844078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:22.881843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d05d-f8c8-4926-8488-262af81ca995 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.896536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b37aea-f822-4b89-8196-08ee1357ca5c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:22.918714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.919646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.919916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.920187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854/users/336b2a9e09e3463b8bf6d800241dedbb/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.922210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854, user_id=336b2a9e09e3463b8bf6d800241dedbb, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:22.923620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:22.934436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:22.935355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:22.935646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:22.935933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:22.937793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 543/1081] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:47:22 2022] PUT /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854/users/336b2a9e09e3463b8bf6d800241dedbb/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:47:23.014003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:23.015600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:23.068641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:23.127496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 539/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 12:47:23.134390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:23.155194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:23.241043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ddd0-9714-42b0-8f8b-d441ee1b5eb8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:23.277475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:23.278305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:23.278584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:23.278851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:23.289095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:23.290951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7efe3e5b-b5c5-4dde-b58f-b8fbac7a4e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:23.309210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:23.310273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:23.311639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:23.311639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:23.311639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:23.311639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:23.311639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 544/1083] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:23.316218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:23.426540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f6e78-8563-4ae8-aec7-37ac5774cacf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:23.461158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:23.462881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:23.463168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:23.463442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:23.464185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:23.464492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:23.465868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cfd03-e24d-4d8f-b7cb-9cf862ff84b2 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:23.477546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 540/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:23.723867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb5bf-d08e-4ec7-be8f-ba9fab372003 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:23.724108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb5bf-d08e-4ec7-be8f-ba9fab372003 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:23.724456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb5bf-d08e-4ec7-be8f-ba9fab372003 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:23.725882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 545/1085] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:23.731527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:23.731823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:23.732107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:23.749875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:23.751173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:23.754260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:23.823561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 541/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:23.846563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb5bf-d08e-4ec7-be8f-ba9fab372003 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:23.917667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:23.948324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb5bf-d08e-4ec7-be8f-ba9fab372003 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:23.982093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:23.982857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:23.983138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:23.983412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:23.994004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:24.002022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:24.003150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:24.004018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 546/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Tue May 24 12:47:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:24.009806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.110566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f010e7-01e7-4e0a-b718-e9a6427ce1d2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.144597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.145344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.145627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.145902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:24.146672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:24.146977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:24.148352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:24.157638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 542/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:24.163341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.264508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9028-888a-4ca0-b3be-7d1c8ab2dbea None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.291595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:24.297573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.298388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.298668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.298941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:24.310266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:24.311697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:24.329151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:24.330037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:24.330954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:24.330954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:24.330954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:24.330954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:24.330954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 547/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:24.335936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.339524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:24.438289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26482b-2841-4058-a69e-af78e3c65252 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.471251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.471908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.472192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.472469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:24.473309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:24.473620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:24.475041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:24.487118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 543/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:24.493068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.597559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1c0b-7b54-4e14-a87b-7a2ce250932a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.631369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.632206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.632512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.632828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:24.640421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:24.641858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:47:24.656124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:24.657123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:24.658154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 548/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:24.663099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.723876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:24.763278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95032430-4bb7-4d80-9e0e-f4b2099e299e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.796550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.797221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.797504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.797782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:24.798655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:24.798968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:24.800408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:24.817804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 544/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:24.823691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:24.866648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:24.924302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfcd4-4e6d-4a94-bb92-f339c179b495 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:24.957484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:24.958152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:24.958444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:24.958725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.030789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.032242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52598020-2e9f-4929-ae6c-8acabf525f61 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.075616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.132447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 549/1093] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:25.138712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.175674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a0d5-fb47-47d6-b624-55ed368329b5 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.176185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a0d5-fb47-47d6-b624-55ed368329b5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.176297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a0d5-fb47-47d6-b624-55ed368329b5 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.177614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 550/1094] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:47:25.183245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.183531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.183809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.201371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:25.202597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:25.247659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f54f98-a1ac-48d0-a629-bea55fbff390 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.268359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.270812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 551/1095] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:25.282672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.283460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.283740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.284012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.294225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.294624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.295693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:25.313789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:25.314764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:25.315643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:47:25.315643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:25.315643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:47:25.315643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:25.315643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 545/1096] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:25.321428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.365964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.396678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d64dc3-e74c-4fbb-8443-2dfd8eca211f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.421313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23994-98c4-4882-a12b-4bf770df20ce None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.432894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.433687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.433966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.434270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.444466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:25.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:25.453237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:25.454056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 552/1097] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:25.459258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.459390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.459973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.460259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.460536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.461340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:25.461647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.463058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.474452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 546/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:25.480605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.515098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.561471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12ec2a-d448-4bfb-be24-f2e06146db35 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.582928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6b9e-cc23-4a02-bc8a-2b86a3e1f217 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.590964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.596562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.597228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.597568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.597856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.598668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:25.598976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.600348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.608484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 553/1099] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:25.614259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.616419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.617206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.617517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.617993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.625149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.626630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:47:25.642040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:25.643074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:25.643983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 547/1100] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:47:25.649488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.714618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0496d5-ec55-46da-b1e2-985535c2f435 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.738443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.748340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.748515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357092f5-7807-479f-bcd8-72a00cfeecd8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.749212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.749496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.749783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] PATH_INFO: `/v3/users/336b2a9e09e3463b8bf6d800241dedbb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.750999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] RBAC: Authorizing `identity:get_user(user_id=336b2a9e09e3463b8bf6d800241dedbb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.752433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.754103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 554/1101] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/users/336b2a9e09e3463b8bf6d800241dedbb => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:25.760177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.784303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.784960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.785245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.785519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.786439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:25.786750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.788273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.800240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 548/1102] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:25.806547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:25.821386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:25.861008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789508-491a-464d-9ea6-0fe8c29a08eb None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.894317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.894959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.895244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.895529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.905766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f49ac-bebc-42a0-a17f-49e3bf1f9c7c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:25.938935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:25.939580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:25.939865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:25.940142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:25.940959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] RBAC: Adding query filter params (role.id=685119bda8b249a6ad16c4af0d17282d, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=0532ebb4e77b41179663accaa80e4942) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:25.941273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.942749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:25.948992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 549/1103] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/role_assignments?user.id=0532ebb4e77b41179663accaa80e4942&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=685119bda8b249a6ad16c4af0d17282d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:47:25.963970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:25.965450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:26.031407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:26.076139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 555/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 12:47:26.082020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:26.101995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:26.190858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a349b-1195-4bed-aae9-fb253f892b8d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:26.225777 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:26.226695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:26.227394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:26.227394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:26.228532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:26.229990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae0ac6-0fa5-44f4-8e8a-6486b88f0815 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:26.231780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 550/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:26 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:26.237893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:26.342747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d444-7b96-4d39-8aad-1b667ee44a8c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:26.377624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:26.378334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:26.378620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:26.378897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:26.379989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854, user.id=336b2a9e09e3463b8bf6d800241dedbb) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:26.380304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:26.381727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0068a5-1dbd-4ab0-b85e-0252fd1b31f7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:26.389056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 556/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:26 2022] GET /identity/v3/role_assignments?user.id=336b2a9e09e3463b8bf6d800241dedbb&scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:28.618672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cfa8-917d-46de-b846-139c5bad4e58 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:28.619198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cfa8-917d-46de-b846-139c5bad4e58 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:28.619198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cfa8-917d-46de-b846-139c5bad4e58 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:28.620620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 551/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:28.625924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:28.626402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:28.626496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:28.643248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:28.644424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:28.664624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:28.710039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 557/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:28.735360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cfa8-917d-46de-b846-139c5bad4e58 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:28.818008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:28.834458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cfa8-917d-46de-b846-139c5bad4e58 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:28.867831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:28.868611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:28.868894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:28.869171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:28.870365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:28.871800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68aeb8-94d2-4b72-b9b5-748a3e87023c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:28.873425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 552/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:28.879273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:28.974380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727be7-0d8d-454a-a83c-759f7458e3cd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:29.007448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:29.008110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:29.008395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:29.008672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:29.009379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:29.010824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12782ec-fb84-43e8-bf15-a388900af906 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:29.030451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 558/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:47:28 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:31.259116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae701a-00af-4585-be59-0ac24e2d784e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:31.259644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae701a-00af-4585-be59-0ac24e2d784e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:31.259644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae701a-00af-4585-be59-0ac24e2d784e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:31.261152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 553/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:31.266699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:31.267141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:31.267248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:31.285445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:31.286684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:31.294535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:31.354975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 559/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:31.382459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae701a-00af-4585-be59-0ac24e2d784e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:31.483330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae701a-00af-4585-be59-0ac24e2d784e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:31.517088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:31.517879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:31.518189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:31.518469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] PATH_INFO: `/v3/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:31.519938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] RBAC: Authorizing `identity:get_role(role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:31.521323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:31.522764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 554/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:31 2022] GET /identity/v3/roles/1416455d2fac4316b955fc157b047ccd => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:31.529535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:31.625903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0c91-f3c7-4983-adb1-657a75f727d7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:31.659765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:31.660619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:31.660900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:31.661173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] PATH_INFO: `/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:31.672026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:31.674480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] RBAC: Authorizing `identity:get_user(user_id=bc6f4d7bdce44dc49ff122e7b040cdf6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:31.676283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:31.678391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 560/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:31 2022] GET /identity/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:31.684675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:31.706966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:31.785118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232c72f-4536-49e2-a6c2-cf86aa66b558 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:31.817838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:31.818511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:31.818800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:31.819079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:31.885012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:31.886484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:31.906123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:31.982389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 555/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:31.988261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:32.085549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed78c8d-b387-43d1-9c91-3b2f8a55b20d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:32.118844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:32.119693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:32.119972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:32.120239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:32.121393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:32.122839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb7c12-a39a-4f77-992c-2b55900f33f0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:32.124539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 561/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:31 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:32.130678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:32.227910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e864314-c84d-40c8-99dd-771a3be436f9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:32.247730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:32.261945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:32.262639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:32.262926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:32.263202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:32.264027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854, user.id=bc6f4d7bdce44dc49ff122e7b040cdf6) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:32.264344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:32.265782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ce3b-50af-4eae-82ba-c1793defd6e5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:32.271183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 556/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:32 2022] GET /identity/v3/role_assignments?user.id=bc6f4d7bdce44dc49ff122e7b040cdf6&scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854&role.id=1416455d2fac4316b955fc157b047ccd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:34.432526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604a4-9996-4060-90eb-e982f146905d None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:34.432931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604a4-9996-4060-90eb-e982f146905d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:34.433074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604a4-9996-4060-90eb-e982f146905d None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:34.434523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 562/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:34.439736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:34.440131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:34.440302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:34.457655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:34.458878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:34.524452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 557/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:34.546732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b604a4-9996-4060-90eb-e982f146905d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:34.612753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:34.646665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b604a4-9996-4060-90eb-e982f146905d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:34.680672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:34.681463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:34.681742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:34.682014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] PATH_INFO: `/v3/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:34.683508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] RBAC: Authorizing `identity:get_role(role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:34.684865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:34.686281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 563/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:34 2022] GET /identity/v3/roles/1416455d2fac4316b955fc157b047ccd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:34.691957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:34.789409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51ce5c-8202-4348-9535-ff9d27eee0b0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:34.803000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:34.824294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:34.825171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:34.825459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:34.825737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] PATH_INFO: `/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:34.826949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] RBAC: Authorizing `identity:get_user(user_id=bc6f4d7bdce44dc49ff122e7b040cdf6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:34.828388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:34.830037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 558/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:34 2022] GET /identity/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:34.835657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:34.932095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb6439-26a9-4aff-8dd6-b56150003aa7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:34.964752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:34.965590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:34.965869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:34.966162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:34.967322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:34.968739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18ae8f-125e-4419-a45b-8505d2e9849a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:34.970467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 564/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:34 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:34.976116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:35.075575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a404-855f-44cc-8d82-6caf6104ab3c None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:35.109514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:35.110417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:35.110702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:35.110976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854/users/bc6f4d7bdce44dc49ff122e7b040cdf6/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:35.113149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854, user_id=bc6f4d7bdce44dc49ff122e7b040cdf6, role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:35.114616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce360-e991-4e97-a6be-4560a56179b9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:35.127126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 559/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:47:34 2022] PUT /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854/users/bc6f4d7bdce44dc49ff122e7b040cdf6/roles/1416455d2fac4316b955fc157b047ccd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:47:37.293757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2619-1f29-4de8-8052-a8284dc56338 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:37.294349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2619-1f29-4de8-8052-a8284dc56338 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:37.294349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd2619-1f29-4de8-8052-a8284dc56338 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:37.295742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 565/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:37.301257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:37.301656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:37.301848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:37.318895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:37.320765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:37.355359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:37.388523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 560/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:37.412168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd2619-1f29-4de8-8052-a8284dc56338 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:37.416047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:37.512964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd2619-1f29-4de8-8052-a8284dc56338 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:37.545477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:37.546286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:37.546565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:37.546836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] PATH_INFO: `/v3/roles/1416455d2fac4316b955fc157b047ccd` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:37.548263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] RBAC: Authorizing `identity:get_role(role_id=1416455d2fac4316b955fc157b047ccd)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:37.549622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:37.551040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 566/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:37 2022] GET /identity/v3/roles/1416455d2fac4316b955fc157b047ccd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:37.557276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:37.655457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea81147-c29a-4d82-b83e-6bd8b0f8b8b3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:37.688693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:37.689541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:37.689822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:37.690095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] PATH_INFO: `/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:37.691353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=bc6f4d7bdce44dc49ff122e7b040cdf6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:37.692778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:37.694436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 561/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:37 2022] GET /identity/v3/users/bc6f4d7bdce44dc49ff122e7b040cdf6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:37.700727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:37.771037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:37.800766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119d7b-b422-4cbb-a2fd-3f708db6f3c4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:37.833647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:37.834313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:37.834603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:37.834882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:37.900640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:37.902095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:37.968789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:37.999588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 567/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:38.005572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:38.046900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:38.104456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cad0da-552e-494d-8145-d6e365ffa0c4 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:38.137975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:38.138851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:38.139135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:38.139408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] PATH_INFO: `/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:38.140577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad70ead20ca4e2b8fd3bf8e7a894854)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:38.142018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d3104-e49d-459e-b7e8-df538e2316a6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:38.143798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 562/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:38 2022] GET /identity/v3/projects/5ad70ead20ca4e2b8fd3bf8e7a894854 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:38.149937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:38.246965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfb61-e523-4d5a-8d88-be3a203789b5 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:38.280900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:38.281541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:38.281825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:38.282101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:38.282953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] RBAC: Adding query filter params (role.id=1416455d2fac4316b955fc157b047ccd, scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854, user.id=bc6f4d7bdce44dc49ff122e7b040cdf6) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:38.283267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:38.284672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3698e0-96de-4694-aa2a-ccacd0b41662 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:38.290514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 568/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:38 2022] GET /identity/v3/role_assignments?user.id=bc6f4d7bdce44dc49ff122e7b040cdf6&scope.project.id=5ad70ead20ca4e2b8fd3bf8e7a894854&role.id=1416455d2fac4316b955fc157b047ccd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:40.489022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896231e3-761b-40b7-94d0-38b65fa11b55 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:40.489503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896231e3-761b-40b7-94d0-38b65fa11b55 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:40.489610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896231e3-761b-40b7-94d0-38b65fa11b55 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:40.491024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 563/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:40.496279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:40.496686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:40.496841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:40.514002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:40.515219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:40.543274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:40.579872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 569/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:40.604144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896231e3-761b-40b7-94d0-38b65fa11b55 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:40.703911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896231e3-761b-40b7-94d0-38b65fa11b55 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:40.713266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:40.737991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:40.738798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:40.739084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:40.739358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:40.740529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:40.742043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae280f4-9792-422d-8dcf-bacc88894d38 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:40.743719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 564/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:40.749476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:40.845833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bde538-a304-42f1-b17b-79e5018fc545 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:40.878558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:40.879458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:40.879740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:40.880015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:40.880711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:40.882131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd073a8d-a6cb-43b4-9f3e-5b993595bc24 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:40.906989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 570/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:47:40 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:43.144703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186959e4-b7a1-4601-8199-2df83af46e30 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:43.145230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186959e4-b7a1-4601-8199-2df83af46e30 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:43.145230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186959e4-b7a1-4601-8199-2df83af46e30 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:43.146683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 565/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:43.152921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:43.153338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:43.153481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:43.170525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:43.171709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:43.184497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:43.238098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 571/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:47:43.262950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186959e4-b7a1-4601-8199-2df83af46e30 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:43.365278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186959e4-b7a1-4601-8199-2df83af46e30 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:43.400428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:43.401146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:43.401430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:43.401705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:43.402913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:43.404408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf95e-6485-4ebf-9800-53f973fe1f75 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:43.406279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 566/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:47:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:43.412601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:43.510310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5908bb9-aaa1-45b1-99f9-ab3c94b27660 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:43.544065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:43.544728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:43.545013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:43.545298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:43.546003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:43.547467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12db9-1871-4d9e-96ba-90b0be1134f1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:43.566389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 572/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:47:43 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:47:45.789855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f2c9-e03b-422f-9064-9b3d018f83d3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:45.790390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f2c9-e03b-422f-9064-9b3d018f83d3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:45.790486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7f2c9-e03b-422f-9064-9b3d018f83d3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:45.791863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 567/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:45.797196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:45.797628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:45.797758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:45.803679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:45.815413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:45.816596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:45.883286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 573/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:45.907188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7f2c9-e03b-422f-9064-9b3d018f83d3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:45.953812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:46.007786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7f2c9-e03b-422f-9064-9b3d018f83d3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.040779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.041491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.041772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.042044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.051897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:46.060176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:46.061317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:46.062330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 568/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:46.067260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:46.165255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7251bb-afdc-441e-8d0f-1abff93e0d64 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.199049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.199721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.200006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.200282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.201037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:46.201345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:46.202822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:46.204212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:46.212208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 574/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:46.218167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:46.316346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea0895-8927-4114-9e57-2eb0fb53b401 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.318578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:46.349495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.350373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.351209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.351717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] PATH_INFO: `/v3/users/7e27dba8d3494288be0267d6ee99b96f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.364236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] RBAC: Authorizing `identity:get_user(user_id=7e27dba8d3494288be0267d6ee99b96f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:46.365676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:46.368056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 569/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:46 2022] GET /identity/v3/users/7e27dba8d3494288be0267d6ee99b96f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:46.373708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:46.472028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350f2f1-362b-405b-aa64-80bf45b65242 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.505519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.506182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.506470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.506748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.565260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:46.572640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:46.574026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:46.672169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 575/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:46.678132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:46.776224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed1e8-1692-42f2-8c2e-5e88945473a1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.809550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.810421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.810703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.810981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] PATH_INFO: `/v3/projects/82d60e7542f841ccb0920a0599b0d514` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.812153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] RBAC: Authorizing `identity:get_project(project_id=82d60e7542f841ccb0920a0599b0d514)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:46.813599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac671fa-4085-4d9f-95b9-8ac8ea84b38e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:46.815354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 570/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:46 2022] GET /identity/v3/projects/82d60e7542f841ccb0920a0599b0d514 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:46.821995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:46.913045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:46.919370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91d985-dcc3-46a2-a365-606740aa1625 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:46.952773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:46.953411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:46.953772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:46.954052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:46.954923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=82d60e7542f841ccb0920a0599b0d514, user.id=7e27dba8d3494288be0267d6ee99b96f) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:46.955239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:46.956654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b69b4-4968-49da-b7ec-c2da2f2cd064 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:46.962179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 576/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:46 2022] GET /identity/v3/role_assignments?user.id=7e27dba8d3494288be0267d6ee99b96f&scope.project.id=82d60e7542f841ccb0920a0599b0d514&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:49.146829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cb59-6094-4ead-98c7-4b984db6b5bf None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.147868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cb59-6094-4ead-98c7-4b984db6b5bf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.148053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85cb59-6094-4ead-98c7-4b984db6b5bf None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.150247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 571/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:49.155623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.156050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.156184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.173525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:49.174740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:49.240314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 577/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:49.262669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85cb59-6094-4ead-98c7-4b984db6b5bf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:49.293139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:49.361922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85cb59-6094-4ead-98c7-4b984db6b5bf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:49.401915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:49.402651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.402932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.403205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.413170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:49.420677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:49.421785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:49.422865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 572/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:49.428009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:49.515595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:49.526045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb366f-c92e-4a16-b91f-6359b64c33f6 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:49.565407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:49.566071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.566382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.566656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.567400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:49.567706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:49.569067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:49.577600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 578/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:49.583480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:49.674951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:49.685692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9da8-8685-4ca1-83bc-d21920d7e1e9 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:49.719093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:49.719944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.720222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.720490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] PATH_INFO: `/v3/users/7e27dba8d3494288be0267d6ee99b96f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.721651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] RBAC: Authorizing `identity:get_user(user_id=7e27dba8d3494288be0267d6ee99b96f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:49.723100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:49.724734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 573/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:49 2022] GET /identity/v3/users/7e27dba8d3494288be0267d6ee99b96f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:49.730939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:49.831220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b6ef-ecea-42e3-9c99-148a7889d6f5 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:49.864624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:49.865474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:49.865751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:49.866020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] PATH_INFO: `/v3/projects/82d60e7542f841ccb0920a0599b0d514` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:49.868181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] RBAC: Authorizing `identity:get_project(project_id=82d60e7542f841ccb0920a0599b0d514)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:49.869598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c830-dc68-4d1d-b121-3564908daafb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:49.871331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 579/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:49 2022] GET /identity/v3/projects/82d60e7542f841ccb0920a0599b0d514 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:49.877102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:49.973797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945186b-05a4-4ef6-b712-055391d88626 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:50.007745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:50.008560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:50.008841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:50.009115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] PATH_INFO: `/v3/projects/82d60e7542f841ccb0920a0599b0d514/users/7e27dba8d3494288be0267d6ee99b96f/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:50.011219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d60e7542f841ccb0920a0599b0d514, user_id=7e27dba8d3494288be0267d6ee99b96f, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:50.012662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b607a9-a2fb-4ac8-8140-9da4c1aefb44 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:50.025722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 574/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:47:49 2022] PUT /identity/v3/projects/82d60e7542f841ccb0920a0599b0d514/users/7e27dba8d3494288be0267d6ee99b96f/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:47:52.206765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d038-60a2-43b7-9157-9cf57dabcaa4 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.207296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d038-60a2-43b7-9157-9cf57dabcaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.207296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305d038-60a2-43b7-9157-9cf57dabcaa4 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.208717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 580/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:52.214083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.214508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.214686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.231953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:52.233142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:52.246543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:52.300298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 575/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:52.325133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305d038-60a2-43b7-9157-9cf57dabcaa4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:52.348325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:52.433825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305d038-60a2-43b7-9157-9cf57dabcaa4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:52.465692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:52.466443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.466727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.466999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.478093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:47:52.485650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:52.486762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:47:52.492691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 581/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:52.493658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:52.589558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a3594-6d8f-4507-b7f5-8cbb55296287 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:52.624350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:52.625010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.625296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.625575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.626348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:52.626659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:52.628137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:52.636843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 576/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:47:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:52.642608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:52.722089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:52.741555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339eff8-9a4b-4082-be8f-071b9322c29e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:52.775018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a741-31a1-44be-9082-d78598277888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:52.775887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a741-31a1-44be-9082-d78598277888 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.776168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a741-31a1-44be-9082-d78598277888 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.776443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a741-31a1-44be-9082-d78598277888 None admin] PATH_INFO: `/v3/users/7e27dba8d3494288be0267d6ee99b96f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.777614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894a741-31a1-44be-9082-d78598277888 None admin] RBAC: Authorizing `identity:get_user(user_id=7e27dba8d3494288be0267d6ee99b96f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:52.779069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894a741-31a1-44be-9082-d78598277888 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:52.780980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 582/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:47:52 2022] GET /identity/v3/users/7e27dba8d3494288be0267d6ee99b96f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:52.786762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:52.800232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:52.888451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa5c1-3d51-43eb-96fc-7bc2c2746194 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:52.921523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:52.922188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:52.922479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:52.922847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:52.988040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:52.989432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:53.000332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:53.087466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 577/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:53.093308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a741-31a1-44be-9082-d78598277888 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:53.191503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a741-31a1-44be-9082-d78598277888 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:53.225299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:53.226331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:53.226616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:53.226891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] PATH_INFO: `/v3/projects/82d60e7542f841ccb0920a0599b0d514` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:53.228062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] RBAC: Authorizing `identity:get_project(project_id=82d60e7542f841ccb0920a0599b0d514)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:53.229484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87330d37-775f-424e-ab0f-87624236ac05 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:53.231227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 583/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:47:53 2022] GET /identity/v3/projects/82d60e7542f841ccb0920a0599b0d514 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:53.237153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:53.334245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78dd8d-8fec-4dc1-8c4e-f5bb0a1c5d25 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:53.345258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:53.368358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:53.369002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:53.369284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:53.369558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:53.370418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=82d60e7542f841ccb0920a0599b0d514, user.id=7e27dba8d3494288be0267d6ee99b96f) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:53.370731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:53.372165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f60b98-29b9-4f59-910a-9870d4398360 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:53.377991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 578/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:47:53 2022] GET /identity/v3/role_assignments?user.id=7e27dba8d3494288be0267d6ee99b96f&scope.project.id=82d60e7542f841ccb0920a0599b0d514&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:55.688325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d5e8-d527-42a9-a709-5f37ec079e21 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:55.688874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d5e8-d527-42a9-a709-5f37ec079e21 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:55.688874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d5e8-d527-42a9-a709-5f37ec079e21 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:55.690226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 584/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:55.696476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:55.696873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:55.697020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:55.713546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:55.714770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:55.781230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 579/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:55.803766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636d5e8-d527-42a9-a709-5f37ec079e21 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:55.821794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:55.903595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636d5e8-d527-42a9-a709-5f37ec079e21 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:55.937285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:55.937910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:55.938220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:55.938547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:56.003818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:56.005248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:56.021358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:56.101403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 585/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:47:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:47:56.107488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:56.204139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776681c-f1ef-484a-ac12-e0671a8afd9b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:56.206350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:56.237738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:56.238557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:56.238846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:56.239129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:56.245648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:56.247134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-5573aab1-23e7-4d23-bc8d-38999bf1d34e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:47:56.261939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:47:56.263250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:47:56.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 580/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:47:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:47:56.269232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:56.365666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14ba0-2f57-4317-8791-cf2696d16b1d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:56.382815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:47:56.400939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:56.401594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:56.401878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:56.402183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:56.402903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:47:56.403207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:56.404576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a07b-4b6f-4634-b7af-3d90c4b34fae None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:56.411811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 586/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue May 24 12:47:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:47:58.582853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9d8c-bf2c-4bd0-9f0d-d5e54256be6f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:58.583388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9d8c-bf2c-4bd0-9f0d-d5e54256be6f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:58.583388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9d8c-bf2c-4bd0-9f0d-d5e54256be6f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:58.584868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 581/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:47:58.590882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba14e8-2b5a-431a-8468-2e0651874efc None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:58.591276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba14e8-2b5a-431a-8468-2e0651874efc None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:58.591437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba14e8-2b5a-431a-8468-2e0651874efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:58.608290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b6ba14e8-2b5a-431a-8468-2e0651874efc None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:47:58.609452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b6ba14e8-2b5a-431a-8468-2e0651874efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:47:58.675356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 587/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:47:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:47:58.699642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f9d8c-bf2c-4bd0-9f0d-d5e54256be6f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:47:58.799506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f9d8c-bf2c-4bd0-9f0d-d5e54256be6f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:47:58.833565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:47:58.834244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:47:58.834561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:47:58.834838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:47:58.835585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:47:58.836961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7277a9e-021e-4eb8-ae16-220332460ae6 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:47:58.851161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 582/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue May 24 12:47:58 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:48:01.114799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb11e0-1c13-4dba-ae46-d9cd47012f92 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:01.115327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb11e0-1c13-4dba-ae46-d9cd47012f92 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:01.115327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb11e0-1c13-4dba-ae46-d9cd47012f92 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:01.116953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 588/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:48:01.122151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:01.122549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:01.122738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:01.139611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:48:01.140785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:48:01.158156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:01.206686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 583/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:48:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:48:01.231095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb11e0-1c13-4dba-ae46-d9cd47012f92 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:01.330074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb11e0-1c13-4dba-ae46-d9cd47012f92 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:01.340944 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:01.363960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:01.364859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:01.365099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:01.365373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] PATH_INFO: `/v3/domains/005bb66a5fda448c93dbd83e5edd07d6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:01.375881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=005bb66a5fda448c93dbd83e5edd07d6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:01.377323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030d36c-ada2-4226-82bf-673425b80644 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:01.379307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 589/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue May 24 12:48:01 2022] GET /identity/v3/domains/005bb66a5fda448c93dbd83e5edd07d6 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:01.385554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:01.485718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4c12-71b3-4452-a083-a52e2e72c64c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:01.518906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:01.519550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:01.519829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:01.520099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:01.520801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:01.522949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd186da-d330-4997-822a-1b385279ebc3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:01.546599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 584/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:48:01 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:48:03.761981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d894-6532-4fd7-a1da-123383a05df8 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:03.762525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d894-6532-4fd7-a1da-123383a05df8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:03.762525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d894-6532-4fd7-a1da-123383a05df8 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:03.763878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 590/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:48:03.769016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:03.769387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:03.769569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:03.781501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:03.786970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:48:03.789032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:48:03.853915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 585/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:48:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:48:03.879024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d894-6532-4fd7-a1da-123383a05df8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:03.979201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d894-6532-4fd7-a1da-123383a05df8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:04.013032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:04.013824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:04.014133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:04.014413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] PATH_INFO: `/v3/domains/005bb66a5fda448c93dbd83e5edd07d6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:04.015568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=005bb66a5fda448c93dbd83e5edd07d6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:04.016987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa550f-d410-48c8-9a4e-a4d82f28fef0 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:04.018658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 591/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue May 24 12:48:03 2022] GET /identity/v3/domains/005bb66a5fda448c93dbd83e5edd07d6 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:04.024590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:04.121255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd82de-4d64-4065-98b6-f0b3486dd6e5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:04.155346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:04.156011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:04.156300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:04.156578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:04.157292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:04.158770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfe6af-bbb6-4bf7-9ca7-8d31d78d2018 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:04.166370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:04.179667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 586/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:48:04 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:48:06.417241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78943e-5bad-4c93-9231-43c40e978a0f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:06.417664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78943e-5bad-4c93-9231-43c40e978a0f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:06.417794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78943e-5bad-4c93-9231-43c40e978a0f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:06.419256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 592/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:48:06.424537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:06.424911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:06.425095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:06.441522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:48:06.442753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:48:06.507947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 587/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:48:06.530852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78943e-5bad-4c93-9231-43c40e978a0f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:06.573331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:06.635205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78943e-5bad-4c93-9231-43c40e978a0f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:06.668194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:06.668905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:06.669186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:06.669458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:06.680683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:48:06.688269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:48:06.689399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:48:06.690430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 593/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:48:06.695410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:06.792099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54338eb8-f899-4ad4-bb84-bb07d608439c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:06.814373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:06.827158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:06.827821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:06.828108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:06.828385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:06.829131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:48:06.829441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:06.830848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:06.838842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 588/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:06.844531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:06.939845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:06.944105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4140-fe3a-4400-8498-f55d1756931c None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:06.978435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:06.979295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:06.979578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:06.979852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] PATH_INFO: `/v3/users/1f704f401ad54d3c91b57aa08f5b4511` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:06.992983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] RBAC: Authorizing `identity:get_user(user_id=1f704f401ad54d3c91b57aa08f5b4511)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:06.994446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:06.996124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 594/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:48:06 2022] GET /identity/v3/users/1f704f401ad54d3c91b57aa08f5b4511 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:07.001698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:07.098914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453e3d1-5243-412f-b93d-dc1d66238463 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:07.131534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:07.132167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:07.132450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:07.132728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:07.184591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:07.200062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:07.201464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:07.297208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 589/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:48:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:48:07.303527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:07.402293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da099-6491-4e2f-9c2e-87e9a71a056d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:07.437597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:07.438488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:07.438775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:07.439048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] PATH_INFO: `/v3/projects/c0df54191605464b8a902a1431bfd41c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:07.440294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] RBAC: Authorizing `identity:get_project(project_id=c0df54191605464b8a902a1431bfd41c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:07.441735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcba2f-d1ea-4587-81a4-8f0e04a089f6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:07.444345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 595/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:48:07 2022] GET /identity/v3/projects/c0df54191605464b8a902a1431bfd41c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:07.450157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:07.531500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:07.547163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c848e78-5310-4ea2-94e7-c6c54fa2fe61 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:07.581157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:07.581793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:07.582072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:07.582372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:07.583191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=c0df54191605464b8a902a1431bfd41c, user.id=1f704f401ad54d3c91b57aa08f5b4511) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:48:07.583499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:07.586038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b3b7-d79a-481c-880f-b267f0b6cf52 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:07.591359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 590/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:48:07 2022] GET /identity/v3/role_assignments?user.id=1f704f401ad54d3c91b57aa08f5b4511&scope.project.id=c0df54191605464b8a902a1431bfd41c&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:09.745932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5b0a-270b-40c2-896c-114481c9a1b0 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:09.746464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5b0a-270b-40c2-896c-114481c9a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:09.746464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5b0a-270b-40c2-896c-114481c9a1b0 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:09.747818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 596/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:48:09.753384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:09.753751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:09.753941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:09.771032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:48:09.772894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:48:09.838313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 591/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:48:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:48:09.860649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a5b0a-270b-40c2-896c-114481c9a1b0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:09.886458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:09.962452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a5b0a-270b-40c2-896c-114481c9a1b0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:09.995897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:09.996718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:09.996947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:09.997219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:10.008198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:48:10.016470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:48:10.017556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:48:10.018608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 597/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:48:10.023797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:10.099798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:10.121047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f694b2-e98c-4c9b-8ff1-697e48de29b9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:10.154487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:10.155151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:10.155436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:10.155714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:10.156459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:48:10.156767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:10.158162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:10.166123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 592/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:10.171957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:10.255257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:10.272553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbee58-9dda-4dcb-8a80-6870425d849d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:10.305672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:10.306559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:10.306846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:10.307122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] PATH_INFO: `/v3/users/1f704f401ad54d3c91b57aa08f5b4511` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:10.308299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] RBAC: Authorizing `identity:get_user(user_id=1f704f401ad54d3c91b57aa08f5b4511)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:10.309734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:10.311408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 598/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:48:10 2022] GET /identity/v3/users/1f704f401ad54d3c91b57aa08f5b4511 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:10.317030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:10.414960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d3e57-09ab-4019-8cae-621cf1bee58e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:10.448246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:10.449091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:10.449378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:10.449655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] PATH_INFO: `/v3/projects/c0df54191605464b8a902a1431bfd41c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:10.450849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] RBAC: Authorizing `identity:get_project(project_id=c0df54191605464b8a902a1431bfd41c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:10.452294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b0aaa-5fc9-4bc6-8486-4ee69df58257 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:10.454017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 593/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:48:10 2022] GET /identity/v3/projects/c0df54191605464b8a902a1431bfd41c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:10.460171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:10.559394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01201e-67e4-4f8c-8527-271a6718b434 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:10.591579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:10.592459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:10.592742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:10.593019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] PATH_INFO: `/v3/projects/c0df54191605464b8a902a1431bfd41c/users/1f704f401ad54d3c91b57aa08f5b4511/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:10.594999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] RBAC: Authorizing `identity:create_grant(project_id=c0df54191605464b8a902a1431bfd41c, user_id=1f704f401ad54d3c91b57aa08f5b4511, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:10.596425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acef98-37fb-46ea-80b1-1e7d89ecac1c None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:10.609368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 599/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:48:10 2022] PUT /identity/v3/projects/c0df54191605464b8a902a1431bfd41c/users/1f704f401ad54d3c91b57aa08f5b4511/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 12:48:12.783353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079ff9-b85a-4440-81d8-27f4d3a3cfdf None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:12.783873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079ff9-b85a-4440-81d8-27f4d3a3cfdf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:12.783984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079ff9-b85a-4440-81d8-27f4d3a3cfdf None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:12.785326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 594/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:48:12.791290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:12.791703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:12.791841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:12.809307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:48:12.810508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:48:12.817471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:12.876924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 600/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:48:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:48:12.900025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab079ff9-b85a-4440-81d8-27f4d3a3cfdf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:12.911246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:13.001468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab079ff9-b85a-4440-81d8-27f4d3a3cfdf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.034595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.035319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.035604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.035883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.046596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:48:13.054451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:48:13.055525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:48:13.056747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 595/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:48:13.061482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:13.158470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10191a-b5d3-485b-a25b-dc21beb16774 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.192071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.192728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.193012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.193292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.194033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:48:13.194369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:13.195728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:13.203651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 601/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:13.209820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:13.275350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:13.308310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924e7c9-b7fd-4f7f-a47b-799c89b7a4a1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.341625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.342523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.342810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.343087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] PATH_INFO: `/v3/users/1f704f401ad54d3c91b57aa08f5b4511` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.344275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] RBAC: Authorizing `identity:get_user(user_id=1f704f401ad54d3c91b57aa08f5b4511)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:13.345734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:13.347427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 596/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue May 24 12:48:13 2022] GET /identity/v3/users/1f704f401ad54d3c91b57aa08f5b4511 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:13.353430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:13.357159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:13.453407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2321a-f805-422d-9d3d-c927223d90dd None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.486131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.486771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.487052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.487323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.554068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:13.555534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:13.558104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:13.651408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 602/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:48:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:48:13.657190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:13.760477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d7e5-7fb7-4129-b7c9-dacc5292da15 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.792216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.793057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.793338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.793612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] PATH_INFO: `/v3/projects/c0df54191605464b8a902a1431bfd41c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.794780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=c0df54191605464b8a902a1431bfd41c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:13.796223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403b868-ae52-412e-b28a-bd2d91acf2c9 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:13.797928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 597/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue May 24 12:48:13 2022] GET /identity/v3/projects/c0df54191605464b8a902a1431bfd41c => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:13.804885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:48:13.901584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f80d-8fcf-451e-b92f-b3746cfc7ca8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:48:13.903826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:13.935608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:48:13.936254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:48:13.936536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:48:13.936810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:48:13.937631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=c0df54191605464b8a902a1431bfd41c, user.id=1f704f401ad54d3c91b57aa08f5b4511) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:48:13.937942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:48:13.939382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09500151-e1c3-404d-a06e-7230d3ce72c2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:48:13.945791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 603/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:48:13 2022] GET /identity/v3/role_assignments?user.id=1f704f401ad54d3c91b57aa08f5b4511&scope.project.id=c0df54191605464b8a902a1431bfd41c&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:48:23.788573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:48:23.943031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=16 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:14.202165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d1f2-467f-4a23-8a50-1da8ab8ef75b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:14.202165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d1f2-467f-4a23-8a50-1da8ab8ef75b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:14.202165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4d1f2-467f-4a23-8a50-1da8ab8ef75b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:14.203191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 598/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:49:14.209536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:14.210094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:14.210365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:14.230248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:14.231716 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:14.313387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 604/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:14.339239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d1f2-467f-4a23-8a50-1da8ab8ef75b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:14.489973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4d1f2-467f-4a23-8a50-1da8ab8ef75b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:14.532393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:14.533721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:14.534074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:14.534521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:14.551653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:14.553165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:14.572958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:14.574558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:14.575523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:14.575523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:14.575523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:14.575523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:14.575523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 599/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:14.580883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:14.730897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51552f-6872-409f-9e89-f4d1a3425706 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:14.772114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:14.784901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:14.785676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:14.786012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:14.786362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:14.787380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:14.787795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:14.789496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba001-d0a3-4f32-ae50-44152f24b8fb None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:14.810148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 605/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:14.811872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:14.882944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:14.949735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b24e-0c42-42eb-93d2-40110813f4d3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:14.989956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:14.990710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:14.990999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:14.991340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:14.992054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:14.993567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd73c8-f69d-4291-9dfd-3bfe8032013b None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:15.020494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 600/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue May 24 12:49:14 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:49:17.632984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c1fc-6302-4275-a805-9efff4c99281 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:17.633721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c1fc-6302-4275-a805-9efff4c99281 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:17.633721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c1fc-6302-4275-a805-9efff4c99281 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:17.635183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 606/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:17.640442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:17.641059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:17.641059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:17.663494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:17.664805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:17.747132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 601/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:17.775710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c1fc-6302-4275-a805-9efff4c99281 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:17.897258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c1fc-6302-4275-a805-9efff4c99281 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:17.941822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:17.943130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:17.943447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:17.943770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:17.956820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:17.965728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:17.966804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:17.967701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 607/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:49:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:17.974454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:18.020479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:18.089816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebd5c8-2bef-4a32-9a28-e6fd5468ddf8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:18.141479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:18.142182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:18.143028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:18.143304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:18.144058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:18.144368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:18.146057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:18.162167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 602/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:49:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:18.170155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:18.244897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:18.314000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3dc7-5f8f-4536-a183-a1dbe59a2899 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:18.354260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:18.355328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:18.355785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:18.356071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:18.368017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:18.369515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:18.389959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:18.390996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:18.392973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:18.392973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:18.392973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:18.392973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:18.394305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 608/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:18.400825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:18.519111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:18.522979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f0ac-b13f-48ce-9d26-529433ef7c10 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:18.563641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:18.564887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:18.565194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:18.565501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:18.566468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:18.566823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:18.568264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:18.581985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 603/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:18.587672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:18.705735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44686d-2802-4614-bd6e-14003eea1e61 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:18.707874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:18.745279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:18.746302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:18.746711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:18.747055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:18.756021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:18.757577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:18.773960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:18.775289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:18.776428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:18.777947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 609/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:18.784688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:18.910124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d3d4-5490-4ae1-85a3-88abe64d6d1e None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:18.952808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:18.953498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:18.953782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:18.954056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:18.955475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:18.956281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:18.957871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:18.982817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 604/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:18.984058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:19.097113 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17843f-b80b-497f-95b7-5de132214a9e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:19.133086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:19.133902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:19.134304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:19.134684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:19.170424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:19.213433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:19.215145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:19.325523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 610/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:49:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:49:19.331334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:19.355716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:19.447212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37ee3-ba5e-41c6-9fd9-516e3d90b6dd None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:19.485966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:19.487045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:19.487389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:19.487703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:19.499058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:19.500971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:19.520788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:19.522048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:19.523494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:19.523494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:19.523494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:19.523494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:19.523494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 605/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:19.527763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:19.599862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:19.645811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6cffc-ba90-4867-9837-7964ee32c83d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:19.688271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:19.689103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:19.689713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:19.690166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:19.691059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:19.691471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:19.693033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:19.712020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 611/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:19.713240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:19.795613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:19.836039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653cbc7-b11c-4632-bc3b-8d375b0e2cb3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:19.877984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:19.879258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:19.879830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:19.880420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:19.890332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:19.893518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:19.911640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:19.912829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:19.913941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:19.915649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 606/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:19.921531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:20.056396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd5c2d-10f6-4b79-9424-e48926e1d9a1 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:20.084898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:20.100216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:20.100965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:20.101409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:20.101702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:20.102804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:20.103154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:20.104904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9282c-2a3f-423d-b48e-55e444b82a87 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:20.122047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 612/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:20.130296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:20.273981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f8c8-7e91-4bd0-a1ba-620a11b1b778 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:20.306689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:20.314841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:20.315656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:20.316043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:20.316439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:20.317385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=e19685a3a9224caaba7399f5aa5a44f5) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:20.317824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:20.319402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b60a-fea7-4625-bbcc-37d3f59e58c8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:20.325396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 607/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:49:20 2022] GET /identity/v3/role_assignments?user.id=e19685a3a9224caaba7399f5aa5a44f5&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:22.850473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63217a-edae-4856-bff1-a1d4a44752bd None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:22.851058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63217a-edae-4856-bff1-a1d4a44752bd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:22.851058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63217a-edae-4856-bff1-a1d4a44752bd None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:22.852739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 613/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:22.860603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:22.860603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:22.860603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:22.886812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:22.888813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:22.980071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 608/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:23.006480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63217a-edae-4856-bff1-a1d4a44752bd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.130005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63217a-edae-4856-bff1-a1d4a44752bd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:23.174674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:23.175822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:23.176167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:23.176478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:23.192270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:23.201536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:23.202529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:23.206847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 614/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:23.210372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.317248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9c3ac-bf30-4f8c-8d70-772a6309e665 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:23.343733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:23.356523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:23.357383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:23.357720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:23.358057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:23.359258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] RBAC: Adding query filter params (name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:23.359761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:23.361640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:23.377662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 609/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:23.379051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.429256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:23.494250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127cfb-2f5f-4af4-9d13-0de3d3dbd3ed None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:23.531107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:23.531943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:23.532263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:23.532554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:23.545051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:23.546542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:23.564216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:23.565492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:23.566587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:23.566587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:23.566587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:23.566587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:23.566587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 615/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:23.571593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.683735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dcdee-1a62-4991-a8f2-b00397f1e21d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:23.722589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:23.723255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:23.723537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:23.723810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:23.724537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:23.724845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:23.726253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:23.739259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 610/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:23.745178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.850364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:23.858301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc501d4-7e7e-45e1-9ff1-913f7f39c533 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:23.900137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:23.900939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:23.901221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:23.901494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:23.910303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:23.911828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:23.928406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:23.929735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:23.931390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 616/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:23.936059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:23.988646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:24.049752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918f59-bbfd-4835-8213-b022d0d58072 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:24.091172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:24.091861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:24.092142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:24.092417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:24.093253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:24.093562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:24.095020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:24.114278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 611/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:24.120076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:24.256234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee276-e0c5-4172-8ff6-2e3c8c3c1c2f None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:24.295020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:24.296032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:24.296357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:24.296650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:24.309766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:24.311594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:24.331152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:24.332225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:24.333152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:24.333152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:24.333152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:24.333152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:24.333152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 617/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:24.338752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:24.453903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bf7-8b17-42d7-b46e-2cd557de0582 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:24.456658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:24.494397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:24.495111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:24.495428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:24.495731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:24.496548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:24.496955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:24.498522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:24.519431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 612/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:24.524971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:24.535827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:24.642815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591e88-2de8-4039-b78a-c613dd27d9c4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:24.683827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:24.684677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:24.685008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:24.685303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:24.693007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:24.694522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:24.711047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:24.712092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:24.712977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 618/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:24.719046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:24.834561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f1921-66cc-4e27-9345-d3bef1e3ddc7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:24.868619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:24.869275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:24.869558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:24.869831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:24.870643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:24.870965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:24.872379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac190-30f1-4901-8ffc-b55c30381400 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:24.885811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 613/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:24.891815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:24.960932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:24.997264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a889e0c-8d52-4144-8191-fcf877e5f512 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:25.034897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:25.035795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:25.036075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:25.036347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/e19685a3a9224caaba7399f5aa5a44f5/roles/121f3715a41749cda4e3af11764d5945` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:25.052035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=e19685a3a9224caaba7399f5aa5a44f5, role_id=121f3715a41749cda4e3af11764d5945)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:25.053954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a98ce9-0fc9-46b0-a859-eff96b87ce9b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:25.069044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 619/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:49:24 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/e19685a3a9224caaba7399f5aa5a44f5/roles/121f3715a41749cda4e3af11764d5945 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:49:27.577918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7f9b-0a6f-45f0-a2c7-692206243556 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:27.578590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7f9b-0a6f-45f0-a2c7-692206243556 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:27.578590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c7f9b-0a6f-45f0-a2c7-692206243556 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:27.580312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 614/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:27.586442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:27.586935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:27.587046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:27.607907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:27.609329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:27.684263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 620/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:27.709627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c7f9b-0a6f-45f0-a2c7-692206243556 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:27.738608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:27.828199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c7f9b-0a6f-45f0-a2c7-692206243556 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:27.866875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:27.867683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:27.867962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:27.868238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:27.880680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:27.888982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:27.890321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:27.897116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 615/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue May 24 12:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:27.899440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:27.949898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:28.011644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed32d6-c35a-45fe-9677-28bcaf31791e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.049893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.050629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.050916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.051231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:28.052061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] RBAC: Adding query filter params (name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:28.052369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:28.053775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:28.063006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 621/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue May 24 12:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:28.069371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:28.172968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:28.202256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933e3c-d2f4-4f11-96fd-e5718e44a424 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.240800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.241588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.241871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.242176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:28.254455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:28.255915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:28.276058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:28.277268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:28.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:28.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:28.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:28.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:28.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 616/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:28.283648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:28.396224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b41d7-556a-4eb9-ac88-190cad93f549 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.406105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:28.433198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.433866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.434177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.434462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:28.435187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:28.435500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:28.437142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:28.455794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 622/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:49:28.457115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:28.571241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acd022-f75f-4cbc-a1a0-5dfcd31e4f01 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.609033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.609836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.610139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.610417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:28.614039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:28.619456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:28.620980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:28.637607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:28.638848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:28.639913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 617/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:28.644873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:28.757083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccd2b-fd5b-4d4a-b822-679f2f54414d None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.794352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.795024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.795316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.795581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:28.796410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:28.796717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:28.798833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:28.820237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 623/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:28.825883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:28.936899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bb6f3-eb0f-4663-84a7-0f91fab79c11 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:28.977106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:28.978105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:28.978520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:28.978941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:29.051405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:29.058509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:29.060083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:29.167235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 618/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:49:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:49:29.173875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:29.214938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:29.306301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d97b5-3e42-4d2b-b030-514748e031e7 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:29.347464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:29.348256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:29.348541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:29.348833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:29.359534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:29.361007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:29.380089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:29.381212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:29.382154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:29.382154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:29.382154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:29.382154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:29.382154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 624/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:29.388468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:29.492634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:29.499191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58dfb4-3917-4aed-bec6-f0a05c758fd3 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:29.538122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:29.538838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:29.539169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:29.539474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:29.540325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:29.540638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:29.542048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:29.556939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 619/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:29.563091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:29.653358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:29.677568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd564a-c252-4555-a995-4ea1914b4c52 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:29.718881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:29.719683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:29.720623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:29.721120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:29.727784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:29.729220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:29.743880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:29.744794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:29.745825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 625/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:29.753121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:29.868945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975a20-e0b2-43f6-807d-081cb167571d None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:29.909535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:29.910328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:29.910865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:29.911149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:29.911941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:29.912316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:29.914176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275bedf-93d5-407a-9b18-326679c5f1ad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:29.927378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 620/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:29.934893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:30.059312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918070d5-de57-49af-892d-812c377e3d6a None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:30.099734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:30.100603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:30.101006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:30.101302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:30.102267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] RBAC: Adding query filter params (role.id=121f3715a41749cda4e3af11764d5945, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=e19685a3a9224caaba7399f5aa5a44f5) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:30.102641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:30.104214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae808-e365-43c4-83e0-aa6aef99b859 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:30.112514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 626/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:49:29 2022] GET /identity/v3/role_assignments?user.id=e19685a3a9224caaba7399f5aa5a44f5&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=121f3715a41749cda4e3af11764d5945 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:32.560836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb817f-e00c-444d-9a7f-8eba3ba5a468 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:32.561397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb817f-e00c-444d-9a7f-8eba3ba5a468 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:32.561397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb817f-e00c-444d-9a7f-8eba3ba5a468 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:32.563055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 621/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:32.569293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:32.569838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:32.570008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:32.575552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:32.590120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:32.591330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:32.670958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 627/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:49:32.697999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb817f-e00c-444d-9a7f-8eba3ba5a468 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:32.717057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:32.802728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb817f-e00c-444d-9a7f-8eba3ba5a468 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:32.839531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:32.840324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:32.840649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:32.840887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:32.852989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:32.862002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:32.862978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:32.864045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 622/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:32.869660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:32.983955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721681d1-1cc0-40fa-bebf-5fde779c5e68 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.019032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:33.025196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.026017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.026391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.026671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.027523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:33.027842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.029474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:33.039399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 628/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:33.045079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:33.136640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:33.164689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391851d-4bfb-4e9d-a06f-a9d7e9a02579 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.208010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.208939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.209232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.209602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.223475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.225003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:33.246948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:33.248020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:33.249150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:33.249150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:33.249150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:33.249150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:33.249150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 623/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:33.255477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:33.363596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763f893-ec66-4355-8626-da6e9e437209 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.400200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.400888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.401172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.401449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.402232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:33.402545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.403994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:33.418773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 629/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:49:33.425258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:33.529773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df5a6-238f-40ba-adfe-6a6e9dd44a61 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.557515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:33.566978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.567799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.568080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.568353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.576666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.578165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:33.593394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:33.594493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:33.595948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 624/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 12:49:33.601077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:33.659828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:33.707726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00d2dc-03e7-461c-abc6-23b4b56b03a2 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.741763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.742476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.742759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.743035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.743875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:33.744181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.745602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:33.764414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 630/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:49:33.771084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:33.870792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6681aae-72e3-4d39-9357-28aea9424045 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:33.905344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:33.906020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:33.906380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:33.906684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:33.963124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:33.976536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:33.978201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.073539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 625/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:49:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:49:34.079962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:34.183056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea46b2-80a8-4c3d-aab8-840b1eff8799 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:34.200442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:34.226642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:34.227428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:34.227709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:34.227979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:34.238305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:34.239729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:34.257286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:34.258340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:34.259441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:34.259441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:34.259441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:34.259441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:34.259441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 631/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:34.264121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:34.350994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:34.363522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4056b14-313d-4f63-a150-45428e993858 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:34.399394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:34.400052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:34.400337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:34.400611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:34.401329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:34.401635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:34.403043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.414311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 626/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:34.419741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:34.518174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13572e9-d760-46bb-83f8-2e6b197e98fc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:34.550955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:34.551717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:34.551997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:34.552269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:34.558679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:34.560097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:34.574328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:34.575177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:34.576077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 632/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:34.582325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:34.680225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810286cb-750d-4ced-af0f-8aaf1e8563b7 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:34.713052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:34.713689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:34.713968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:34.714269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:34.715043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:34.715350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:34.716779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e27de-eaf9-416e-b2d5-c3d72317aaea None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.728814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 627/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:34.735025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:34.762701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:34.836063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184c02-d8ad-4963-a757-1779e0adfecc None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:34.868880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:34.869522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:34.869806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:34.870081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:34.870937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=e19685a3a9224caaba7399f5aa5a44f5) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:34.871250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:34.872661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045226ea-f835-4b80-b3a7-cf8c85c91b76 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:34.878936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 633/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:49:34 2022] GET /identity/v3/role_assignments?user.id=e19685a3a9224caaba7399f5aa5a44f5&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:37.092402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c496453-1f9c-4a9d-a020-0ea9b59ebbeb None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.092956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c496453-1f9c-4a9d-a020-0ea9b59ebbeb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.092956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c496453-1f9c-4a9d-a020-0ea9b59ebbeb None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.094449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 628/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:37.099612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.100012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.100172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.117346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:37.118574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:37.192304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 634/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:49:37.223828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c496453-1f9c-4a9d-a020-0ea9b59ebbeb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:37.235868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:37.324984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c496453-1f9c-4a9d-a020-0ea9b59ebbeb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:37.358254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:37.358971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.359250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.359522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.370200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:37.378517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:37.379600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:37.380624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 629/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:49:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:37.385598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:37.403886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:37.484069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e41cb-3e72-4526-acbc-c1a3e839baea None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:37.517299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:37.517966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.518292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.518571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.519311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:37.519615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:37.521043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:37.528938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 635/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:49:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:37.535262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:37.600352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:37.634424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2349d3-3bff-4126-90ac-bfd5ef4a31b2 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:37.666986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:37.667761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.668047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.668328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.679420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:37.680864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:37.697680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:37.698706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:37.699582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:37.699582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:37.699582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:37.699582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:37.699582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 630/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:37.705458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:37.787932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:37.807482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311f45-9842-4059-bcef-0a07c3aa6dfd None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:37.853432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:37.855583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:37.856098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:37.856518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:37.857264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:37.857574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:37.858970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:37.876215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 636/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:37.887247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:37.991638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498292f9-af00-482b-ac79-0d934e1471bf None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.010806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:38.025380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699370-84ad-434c-b696-9c7915143031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.026206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699370-84ad-434c-b696-9c7915143031 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.026492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699370-84ad-434c-b696-9c7915143031 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.026767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699370-84ad-434c-b696-9c7915143031 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.034694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699370-84ad-434c-b696-9c7915143031 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.036136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699370-84ad-434c-b696-9c7915143031 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-45699370-84ad-434c-b696-9c7915143031 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:38.050222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:38.051312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:38.052483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 631/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:38.057325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.157364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364497-67c7-4bb4-be12-e944b8d9328e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.198495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.199166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.199451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.199731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.200565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:38.200877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.202334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.211635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:38.220586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 637/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:38.226239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699370-84ad-434c-b696-9c7915143031 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.328075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699370-84ad-434c-b696-9c7915143031 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.364390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.365170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.365453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.365729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.376873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.378368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:38.395986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:38.397055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:38.398392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:38.398392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:38.398392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:38.398392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:38.398392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 632/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:38.402873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.503024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236bd8-c46b-4acc-93e5-853acc1c6252 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.535366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.536024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.536308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.536583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.537295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:38.537603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.538984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.550646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 638/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:38.556158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.587655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:38.656233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5fee-5a69-417c-9ad8-59d533d5d928 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.688569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.689276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.689561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.689838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.696430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.697883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:38.712306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:38.713331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:38.715093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 633/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:38.719184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.777748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:38.819580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537fc52-945f-4eaa-bd73-a39e2bb9c69e None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:38.852396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:38.853047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:38.853330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:38.853607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:38.854417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:38.854729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:38.856144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d508b9-0357-4841-a21d-47d28ecf0500 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:38.868016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 639/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 12:49:38.873820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:38.963081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:38.971996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72676b1b-631c-441c-956b-e661d8580cc8 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:39.005116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:39.005982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:39.006293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:39.006568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] PATH_INFO: `/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/e19685a3a9224caaba7399f5aa5a44f5/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:39.008499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] RBAC: Authorizing `identity:create_grant(project_id=f53038747e0b48dab76c19f0e22732b1, user_id=e19685a3a9224caaba7399f5aa5a44f5, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:39.009920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd61bf-e8eb-424b-86f6-6544cd407eec None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:39.023011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 634/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue May 24 12:49:38 2022] PUT /identity/v3/projects/f53038747e0b48dab76c19f0e22732b1/users/e19685a3a9224caaba7399f5aa5a44f5/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:49:41.202892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce18cb-8ab8-4ad6-8143-6b09dc0dba6f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.203494 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce18cb-8ab8-4ad6-8143-6b09dc0dba6f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.203908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce18cb-8ab8-4ad6-8143-6b09dc0dba6f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.205456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 640/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:41.211429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.211911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.212034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.230046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:41.231287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:41.296414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 635/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:41.320816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce18cb-8ab8-4ad6-8143-6b09dc0dba6f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:41.421220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce18cb-8ab8-4ad6-8143-6b09dc0dba6f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:41.439750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:41.456101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:41.456818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.457096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.457366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.467073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 12:49:41.475133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:41.476238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:41.477103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 641/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue May 24 12:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:41.482268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:41.561805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:41.581209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bed1-64f7-4bbc-ba77-bd8472ae84f9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:41.614275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:41.614936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.615228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.615502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.616245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:41.616553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:41.617933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:41.626697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 636/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue May 24 12:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:41.632317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:41.729499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdd2e2-6343-444e-bb7d-56b6e4c7d878 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:41.764127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:41.764897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.765175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.765443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.776163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:41.777580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:41.794677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:41.795711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:41.801266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:41.801266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:41.801266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:41.801266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:41.801266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 642/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:41.801624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:41.901336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fde0f-4872-4207-84de-d366ed62d8f1 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:41.933643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:41.934310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:41.934597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:41.934868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:41.935577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:41.935881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:41.937247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:41.949557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 637/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:41.955559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:41.985353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:42.052729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26c45-2465-4b9c-824e-4ae85da58d75 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:42.086344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:42.087127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:42.087412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:42.087687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:42.095832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:42.097253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 12:49:42.111151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:42.112249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 12:49:42.113477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:42.116962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 643/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:42.117939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:42.121698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:42.229307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46c52-3632-4315-a541-432cbae799dc None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:42.264527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:42.265356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:42.265643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:42.265953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:42.266831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:42.267144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:42.268594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:42.285467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 638/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue May 24 12:49:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:42.291211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:42.381982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:42.391792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510a23c-3fb8-47ed-964e-d84f865d2a62 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:42.425774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:42.426450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:42.426730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:42.427001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:42.492791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:42.494248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:42.581097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:42.591045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 644/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue May 24 12:49:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 12:49:42.597967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:42.658656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:42.696207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab43a26-3639-41d3-bf45-aa175ead9e04 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:42.729454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:42.730270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:42.730557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:42.730834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:42.741521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:42.743002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 12:49:42.760471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:42.761502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:42.762859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 12:49:42.762859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 12:49:42.762859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 12:49:42.762859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:42.762859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 639/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:42.767533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:42.866625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f57-8d4c-49a2-af3f-1604a0ac3bfa None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:42.899594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:42.900248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:42.900534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:42.900813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:42.901536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:42.901846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:42.903249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:42.914854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 645/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue May 24 12:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:42.920410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:43.017921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b7473-bfb3-45e1-8e1b-36e3dcca6e43 None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:43.031350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:43.051618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:43.052393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:43.052681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:43.052958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:43.059461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:43.060913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 12:49:43.074535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application with Lock( May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:43.075550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: ERROR keystone.server.flask.application May 24 12:49:43.076466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 640/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue May 24 12:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:43.081923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:43.131624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:43.183887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7b4-7905-4a18-b222-5a1b4acc04f4 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:43.216676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:43.217320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:43.217598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:43.217868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:43.218672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:43.218976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:43.220984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1027-f7eb-4c41-8293-d0f33abe756a None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:43.232509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 646/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue May 24 12:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:43.239183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:43.338694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e375110-e073-4fbe-9f1d-3f086ea86bfe None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:43.383008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:43.383599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:43.383885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:43.384166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:43.384992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] RBAC: Adding query filter params (role.id=5c9b5d36789c41e5a05dfad7f8753c41, scope.project.id=f53038747e0b48dab76c19f0e22732b1, user.id=e19685a3a9224caaba7399f5aa5a44f5) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:43.385304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:43.386784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4651836-e98e-4adc-b591-c37341f3ccad None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:43.392916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 641/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue May 24 12:49:43 2022] GET /identity/v3/role_assignments?user.id=e19685a3a9224caaba7399f5aa5a44f5&scope.project.id=f53038747e0b48dab76c19f0e22732b1&role.id=5c9b5d36789c41e5a05dfad7f8753c41 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:45.632603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259108-aa72-464a-ac80-ce0d3e147c6b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:45.633119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259108-aa72-464a-ac80-ce0d3e147c6b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:45.633206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259108-aa72-464a-ac80-ce0d3e147c6b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:45.634578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 647/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:45.639606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:45.639998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:45.640159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:45.658069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:45.659381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:45.687352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:45.724883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 642/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:45.747246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259108-aa72-464a-ac80-ce0d3e147c6b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:45.846502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259108-aa72-464a-ac80-ce0d3e147c6b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:45.857609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:45.881180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:45.881967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:45.882282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:45.882560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:45.883207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:45.884566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:45.896144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:45.897347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:45.898428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 648/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:49:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:45.903528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:45.998576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728e59-df3f-4b87-b764-3caced63f00a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:46.032336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:46.032862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:46.033142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:46.033412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:46.034105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:46.034430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:46.035794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e507113-96e0-4dc0-8807-68565efbc073 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:46.040508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 643/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 24 12:49:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:46.046044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:46.144574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0761109-1fd2-49d2-8bd5-061b4bfda775 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:46.184557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:46.185309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:46.185641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:46.186000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:46.186903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:46.187246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:46.189405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b348c5-81c4-4de8-ab02-7e3a48f0d7a4 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:46.194876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 649/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 24 12:49:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:48.372043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d527-912e-4383-a354-91ba2e218fdf None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:48.372572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d527-912e-4383-a354-91ba2e218fdf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:48.372572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878d527-912e-4383-a354-91ba2e218fdf None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:48.374308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 644/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:48.380412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb6d8-da63-4eb7-89a6-cc8b65b8c452 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:48.380828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb6d8-da63-4eb7-89a6-cc8b65b8c452 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:48.380969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb6d8-da63-4eb7-89a6-cc8b65b8c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:48.397417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-0edeb6d8-da63-4eb7-89a6-cc8b65b8c452 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:48.398641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0edeb6d8-da63-4eb7-89a6-cc8b65b8c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:48.427932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:48.464484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 650/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 12:49:48.487996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d527-912e-4383-a354-91ba2e218fdf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:48.519168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:48.587492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878d527-912e-4383-a354-91ba2e218fdf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:48.620630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:48.621276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:48.621561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:48.621836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:48.622630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:48.624200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae15e4-6d0b-4fc5-8570-416ded8a46d1 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:48.637875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 645/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue May 24 12:49:48 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:49:50.847993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec32e-7fcb-4fce-be53-e9eeb688089e None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:50.848558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec32e-7fcb-4fce-be53-e9eeb688089e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:50.848558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec32e-7fcb-4fce-be53-e9eeb688089e None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:50.849949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 651/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:50.855093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:50.855495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:50.855660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:50.872041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:50.873223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:50.945015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 646/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:49:50.967241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec32e-7fcb-4fce-be53-e9eeb688089e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:51.066671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec32e-7fcb-4fce-be53-e9eeb688089e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:51.099713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:51.100438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:51.100721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:51.100997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:51.101641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:51.103024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:51.114983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:51.116176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:51.117373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 652/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:49:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:51.122008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:51.141127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:51.223859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac99fc-8ca6-4a62-b0b1-50d9ae794f0f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:51.257505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:51.258184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:51.258475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:51.258752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:51.259457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:51.259765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:51.261143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:51.266524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 647/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 24 12:49:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:51.272519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:51.304156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:51.370410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163aa5-e1c9-4411-bfbc-a0262440f3d8 None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:51.403362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:51.404020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:51.404304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:51.404583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:51.405373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] RBAC: Adding query filter params (interface=public, service_id=edbee74868af405da89accec123b2c24, region_id=RegionOne) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:51.405685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:51.407297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2566aa-fb44-4327-9a06-f7b89b01595b None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:51.412417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 653/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue May 24 12:49:51 2022] GET /identity/v3/endpoints?service_id=edbee74868af405da89accec123b2c24&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:51.417938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:51.498166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:51.517410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07686-af0e-45dc-a523-c6087b9419fa None admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:51.551667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:51.552316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:51.552595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:51.552871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:51.553542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:51.554939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b9a9-081a-4490-9451-d2438729820f None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:51.561854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 648/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue May 24 12:49:51 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:49:53.741737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59111-a1f4-4620-89af-642ac8e610e1 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:53.742261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59111-a1f4-4620-89af-642ac8e610e1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:53.742389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59111-a1f4-4620-89af-642ac8e610e1 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:53.743718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 654/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:49:53.749336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:53.749777 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:53.750064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:53.767184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:49:53.768376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:49:53.833979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 649/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:49:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 12:49:53.856308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59111-a1f4-4620-89af-642ac8e610e1 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:53.950244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:53.957934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea59111-a1f4-4620-89af-642ac8e610e1 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:53.990792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:53.991577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:53.991910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:53.992139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] PATH_INFO: `/v3/services/placement` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:53.992780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:53.994150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 12:49:54.006617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 12:49:54.007781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.get_or_create( May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application with Lock( May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self._enter() May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application return self.creator() May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application created_value = creator( May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: ERROR keystone.server.flask.application May 24 12:49:54.008803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 655/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue May 24 12:49:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 12:49:54.013872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:54.089197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:49:54.111779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3987-fdad-4e83-92e4-3788efbbd7c5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:54.145776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:54.146460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:54.146748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:54.147026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] PATH_INFO: `/v3/services` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:54.147731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:49:54.148063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:54.149439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd602c-9635-49cb-91f2-940643093cf5 None admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:54.154568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 650/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue May 24 12:49:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:49:54.160282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:49:54.258769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01e63-f374-4ff1-9a52-1b0a44a4d0be None admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:49:54.290576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:49:54.291219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:49:54.291504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:49:54.291781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:49:54.292510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:49:54.293868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f9f4-896c-4556-a0a2-b457137191a6 None admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:49:54.311530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 656/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue May 24 12:49:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:50:04.151513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=30 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:50:04.307284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:50:57.965278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183d7f-2d48-40d7-b5b6-5d15d0dca5fc None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:50:57.966962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183d7f-2d48-40d7-b5b6-5d15d0dca5fc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:50:57.967400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183d7f-2d48-40d7-b5b6-5d15d0dca5fc None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:50:57.969072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 651/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:50:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:50:57.975018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc186e-9e63-4b06-ad3a-aa961c75b19c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:50:57.976223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc186e-9e63-4b06-ad3a-aa961c75b19c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:50:57.976710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc186e-9e63-4b06-ad3a-aa961c75b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:50:58.085256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-77dc186e-9e63-4b06-ad3a-aa961c75b19c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:50:58.086902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-77dc186e-9e63-4b06-ad3a-aa961c75b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:50:58.255206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 657/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:50:58.303766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:50:58.304327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:50:58.304833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:50:58.307799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 652/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue May 24 12:50:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:50:58.314336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f44d-333f-4639-bef8-a159fe015e86 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:50:58.314741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f44d-333f-4639-bef8-a159fe015e86 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:50:58.315256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f44d-333f-4639-bef8-a159fe015e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:50:58.422859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ee13f44d-333f-4639-bef8-a159fe015e86 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:50:58.424321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ee13f44d-333f-4639-bef8-a159fe015e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:50:58.452214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:50:58.529486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 658/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue May 24 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:50:58.538558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:50:58.540741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:50:58.668368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbff6e-3f57-451e-badc-a75e61bc954a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:50:58.750218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:50:58.750928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:50:58.751219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:50:58.751497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:50:58.753762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:50:58.814164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:50:58.879345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:50:58.880820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d22d8c-52f8-4a42-9aa2-870e2a859ceb service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:50:58.904040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 653/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:01.398551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:01.399134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:01.399134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:01.400595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 659/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:01.406231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c9b2-1177-4fca-a006-49b3a2a3e57b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:01.406702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c9b2-1177-4fca-a006-49b3a2a3e57b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:01.406798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c9b2-1177-4fca-a006-49b3a2a3e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:01.478459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4a93c9b2-1177-4fca-a006-49b3a2a3e57b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:01.479596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4a93c9b2-1177-4fca-a006-49b3a2a3e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:01.576330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 654/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:01.613655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:01.615218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:01.718722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0afe2-39d8-415b-b1dc-3e889a3136a6 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:01.788800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:01.791551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:01.792384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:01.792831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:01.793110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:01.795573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:01.904753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:01.906232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414009-e06c-4db1-a608-08a57d857b57 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:01.924882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 660/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:04.481496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:04.482048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:04.482176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:04.483575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 655/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:04.489467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe566-d7bf-427a-b42c-5b5029bfe2a6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:04.490008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe566-d7bf-427a-b42c-5b5029bfe2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:04.490008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe566-d7bf-427a-b42c-5b5029bfe2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:04.556875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-75efe566-d7bf-427a-b42c-5b5029bfe2a6 None None] MFA Rules not processed for user `5687ea345df74500817cf00fff7beade`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:04.558138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-75efe566-d7bf-427a-b42c-5b5029bfe2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:04.610566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:04.656073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 661/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:04.695733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:04.697291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:04.709386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:04.812613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149add0a-c235-459b-8a17-5aef6811cae8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:04.888186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:04.888850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:04.889131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:04.889404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:04.892022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:04.966079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:05.013587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:05.015055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c6b4-56c9-41c4-a49f-e8018589f377 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:05.034138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 656/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:07.814085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18153-afab-4d2c-a4b8-5d632f3a3972 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:07.814651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18153-afab-4d2c-a4b8-5d632f3a3972 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:07.814651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18153-afab-4d2c-a4b8-5d632f3a3972 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:07.816079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 662/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:07.821268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d214-a64c-405d-b88b-cb818b5ebc14 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:07.821912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d214-a64c-405d-b88b-cb818b5ebc14 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:07.822245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d214-a64c-405d-b88b-cb818b5ebc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:07.888068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cb79d214-a64c-405d-b88b-cb818b5ebc14 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:07.889283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cb79d214-a64c-405d-b88b-cb818b5ebc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:07.984975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 657/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:08.039707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:08.039993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:08.040272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:08.041680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 663/1320] 10.222.0.36 () {54 vars in 964 bytes} [Tue May 24 12:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:08.047869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb422f-01cf-412f-b738-1df468197a43 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:08.048158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb422f-01cf-412f-b738-1df468197a43 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:08.048436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb422f-01cf-412f-b738-1df468197a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:08.069142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:08.122953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9edb422f-01cf-412f-b738-1df468197a43 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:08.124158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9edb422f-01cf-412f-b738-1df468197a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:08.199975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 658/1321] 10.222.0.36 () {58 vars in 1061 bytes} [Tue May 24 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:08.208841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:08.210430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:08.316364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5497c-e177-440a-987b-b6b1ec948c2f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:08.390160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:08.390741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:08.391026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:08.391301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:08.392930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:08.400388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:08.501416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:08.502879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8475b-5307-4fb8-a7f8-d3f0dfe5fb8e service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:08.521213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 664/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:11.882102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:11.882681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:11.882681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:11.884086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 659/1323] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:11.889990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2ca3-8bc5-4ebb-a315-014a6ba22281 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:11.890460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2ca3-8bc5-4ebb-a315-014a6ba22281 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:11.890739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e2ca3-8bc5-4ebb-a315-014a6ba22281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:11.958133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d13e2ca3-8bc5-4ebb-a315-014a6ba22281 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:11.959345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d13e2ca3-8bc5-4ebb-a315-014a6ba22281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:12.020495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:12.060793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 665/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:12.096404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:12.097945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:12.203116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaf1f0-f208-4c1d-b605-9ce7b33ad877 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:12.215591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:12.278422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:12.279070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:12.279352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:12.279624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:12.281259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:12.395159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:12.396854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ae1ed-ed09-4bbe-8443-7d94e0960ff9 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:12.416072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 660/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:14.739724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:14.740251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:14.740251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:14.741654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 666/1326] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:14.747366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd24b-e448-48c0-a8b6-f52bedc85f43 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:14.747839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd24b-e448-48c0-a8b6-f52bedc85f43 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:14.748149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd24b-e448-48c0-a8b6-f52bedc85f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:14.801874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:14.822177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-02ebd24b-e448-48c0-a8b6-f52bedc85f43 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:14.823426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-02ebd24b-e448-48c0-a8b6-f52bedc85f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:14.922770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 661/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:14.959154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:14.960806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:15.065741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41128c-1a9c-436f-8e84-8a02e552c6ad None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:15.141897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:15.142581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:15.142867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:15.143145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:15.144834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:15.163213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:15.260032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:15.261572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86220b9-97ce-4211-b84c-d81df9a0ae22 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:15.280711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 667/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:17.565039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:17.565583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:17.565583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:17.567054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 662/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:17.572359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11e27-3673-47af-a86d-0dfaf0e81b62 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:17.572751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11e27-3673-47af-a86d-0dfaf0e81b62 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:17.572925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e11e27-3673-47af-a86d-0dfaf0e81b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:17.641532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-10e11e27-3673-47af-a86d-0dfaf0e81b62 None None] MFA Rules not processed for user `5687ea345df74500817cf00fff7beade`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:17.642785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-10e11e27-3673-47af-a86d-0dfaf0e81b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:17.707060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:17.740336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 668/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:17.778756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:17.780350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:17.887393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249f93a-7219-4b71-a411-6ddf31e51a7f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:17.907711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:17.962286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:17.962855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:17.963138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:17.963415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:17.965260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:18.075654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:18.077134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030f01-4b43-462a-be94-356c19f829e3 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:18.095240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 663/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 12:51:20.572935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:20.573519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:20.573519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:20.574986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 669/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:20.580136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8069-ff50-4bc7-b525-ed9bb5ff6b1a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:20.580536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8069-ff50-4bc7-b525-ed9bb5ff6b1a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:20.580697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8069-ff50-4bc7-b525-ed9bb5ff6b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:20.647197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:20.650081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-547f8069-ff50-4bc7-b525-ed9bb5ff6b1a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:20.651884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-547f8069-ff50-4bc7-b525-ed9bb5ff6b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:20.751585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 664/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:20.787250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:20.788763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:20.896828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c02113-96f6-4f6c-8059-d5a822aeabfe None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:20.974630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:20.975293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:20.975576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:20.975853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:20.977499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:21.007048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:21.100560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:21.102006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5214e4-5025-4c7d-97e5-939b96575acb service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:21.121523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 670/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:23.419912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:23.420410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:23.420522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:23.421866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 665/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:23.427070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b2d1-f6db-462e-a0cf-44a65c7ce424 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:23.427478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b2d1-f6db-462e-a0cf-44a65c7ce424 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:23.427626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b2d1-f6db-462e-a0cf-44a65c7ce424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:23.491395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a373b2d1-f6db-462e-a0cf-44a65c7ce424 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:23.492602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a373b2d1-f6db-462e-a0cf-44a65c7ce424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:23.568552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:23.591890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 671/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:23.631832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:23.633360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:23.735861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc47998-7849-469a-9cf8-9d0c6b7f4f77 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:23.764303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:23.809057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:23.809701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:23.809984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:23.810290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:23.811925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:23.920173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:23.921559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf700081-7c8b-4a1f-8769-c4beb73ba200 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:23.940048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 666/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:26.516721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:26.517284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:26.517284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:26.518773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 672/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:26.524093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee6bf3-733d-4e5d-bfbb-6cfda7b0e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:26.524514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee6bf3-733d-4e5d-bfbb-6cfda7b0e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:26.524638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee6bf3-733d-4e5d-bfbb-6cfda7b0e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:26.588420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4dee6bf3-733d-4e5d-bfbb-6cfda7b0e4c4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:26.590238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4dee6bf3-733d-4e5d-bfbb-6cfda7b0e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:26.598362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:26.687120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 667/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:26.723234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:26.724813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:26.829094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3eb66-2f3d-4b56-8af0-714dc92bd319 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:26.901696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:26.902359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:26.902647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:26.902922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:26.904554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:26.939534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:27.013167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:27.014637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff86464-fa2e-4156-8588-d6afc81ae7b9 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:27.032511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 673/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:31.243900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:31.244452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:31.244452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:31.246344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 668/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:31.251466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8b33-c671-4c00-b221-04aa5704ff2b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:31.251895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8b33-c671-4c00-b221-04aa5704ff2b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:31.252024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c8b33-c671-4c00-b221-04aa5704ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:31.326254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c14c8b33-c671-4c00-b221-04aa5704ff2b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:31.327479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c14c8b33-c671-4c00-b221-04aa5704ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:31.421987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:31.435940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 674/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:31.474683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:31.476883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:31.572933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e8522-e67a-47e2-a33b-6d1022cf2740 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:31.577187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:31.577834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:31.578137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:31.578432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:31.587709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:31.589204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d03f-4da9-419f-b3d2-b51c5ba8da07 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:31.598816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 669/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:34.415983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:34.416455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:34.416577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:34.418135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 675/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:34.423397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5d9c-ba64-4b6c-ba9e-cbe2b5cebcd7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:34.423838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5d9c-ba64-4b6c-ba9e-cbe2b5cebcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:34.423952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c5d9c-ba64-4b6c-ba9e-cbe2b5cebcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:34.452443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e84c5d9c-ba64-4b6c-ba9e-cbe2b5cebcd7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:34.453614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e84c5d9c-ba64-4b6c-ba9e-cbe2b5cebcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:34.483173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:34.532839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 670/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:34.569580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:34.571296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:34.584461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8488e-33fb-4cae-9bb2-91b7fc517b63 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:34.587890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:34.588518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:34.588796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:34.589074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:34.598487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:34.599903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab6e4-3415-4fba-8b18-0fe24ac19272 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:34.610204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 676/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:39.111321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d82-86f4-4254-b336-34cffa7eefa3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:39.111868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d82-86f4-4254-b336-34cffa7eefa3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:39.111976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02d82-86f4-4254-b336-34cffa7eefa3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:39.113520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 671/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:39.118837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea60-83c6-4675-ac70-8de47e6a9cda None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:39.119239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea60-83c6-4675-ac70-8de47e6a9cda None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:39.119405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea60-83c6-4675-ac70-8de47e6a9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:39.138867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5f44ea60-83c6-4675-ac70-8de47e6a9cda None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:39.140068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5f44ea60-83c6-4675-ac70-8de47e6a9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:39.147772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 677/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:39.185843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02d82-86f4-4254-b336-34cffa7eefa3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:39.197018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02d82-86f4-4254-b336-34cffa7eefa3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:39.200738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:39.201383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:39.201668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:39.201943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:39.212939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:39.214682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1c07-5c7e-4d02-b3b5-ecf50611bf1c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:39.224619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 672/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:44.660843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148a0-9977-4b7d-b1bf-2ab6c817a9e5 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:44.661675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148a0-9977-4b7d-b1bf-2ab6c817a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:44.662098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148a0-9977-4b7d-b1bf-2ab6c817a9e5 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:44.664157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 678/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 12:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:44.670340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cca7-29c9-4ce5-81cf-3ce86538c77a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:44.671128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cca7-29c9-4ce5-81cf-3ce86538c77a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:44.671608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cca7-29c9-4ce5-81cf-3ce86538c77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:44.750806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-40a6cca7-29c9-4ce5-81cf-3ce86538c77a None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:44.752120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-40a6cca7-29c9-4ce5-81cf-3ce86538c77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:44.899476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 673/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:49.035204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b8ad-f28f-420d-b8e1-2bf62e8910ad None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:49.035777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b8ad-f28f-420d-b8e1-2bf62e8910ad None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:49.035777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b8ad-f28f-420d-b8e1-2bf62e8910ad None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:49.037446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 679/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 12:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:49.043447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaa0f-4f31-4395-b6a6-2e7321928ae1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:49.044426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaa0f-4f31-4395-b6a6-2e7321928ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:49.044926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabaa0f-4f31-4395-b6a6-2e7321928ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:49.064548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7fabaa0f-4f31-4395-b6a6-2e7321928ae1 None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:49.065756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7fabaa0f-4f31-4395-b6a6-2e7321928ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:49.075207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 674/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:49.132886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=13 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:50.585869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe981dc-6231-4511-b873-590719a8e362 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:50.586559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe981dc-6231-4511-b873-590719a8e362 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:50.586559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe981dc-6231-4511-b873-590719a8e362 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:50.588067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 680/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:50.593883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678097b-c411-4a66-afcd-ca99208b99bb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:50.594334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678097b-c411-4a66-afcd-ca99208b99bb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:50.594522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678097b-c411-4a66-afcd-ca99208b99bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:50.613149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9678097b-c411-4a66-afcd-ca99208b99bb None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:50.614364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9678097b-c411-4a66-afcd-ca99208b99bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:50.623780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 675/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:54.512394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aca5e-1d0f-4073-b99d-57474eb28127 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:54.512913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aca5e-1d0f-4073-b99d-57474eb28127 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:54.512913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aca5e-1d0f-4073-b99d-57474eb28127 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:54.514310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 681/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:54.519537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421ad4-8fda-4ca5-862d-1063eccb95f4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:54.519922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421ad4-8fda-4ca5-862d-1063eccb95f4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:54.520099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421ad4-8fda-4ca5-862d-1063eccb95f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:54.539091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-38421ad4-8fda-4ca5-862d-1063eccb95f4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:54.540288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-38421ad4-8fda-4ca5-862d-1063eccb95f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:54.548805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 676/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:54.601891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146b18-09f5-4734-99e6-ed5fe9836040 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:54.602227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146b18-09f5-4734-99e6-ed5fe9836040 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:54.602592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94146b18-09f5-4734-99e6-ed5fe9836040 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:54.604602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 682/1358] 10.222.0.36 () {54 vars in 961 bytes} [Tue May 24 12:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:54.615773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3a80-aeae-4411-8981-4af711aaa147 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:54.616306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3a80-aeae-4411-8981-4af711aaa147 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:54.616781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3a80-aeae-4411-8981-4af711aaa147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:54.668468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:51:54.677158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-5c3d3a80-aeae-4411-8981-4af711aaa147 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:54.678388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5c3d3a80-aeae-4411-8981-4af711aaa147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:54.782586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 677/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Tue May 24 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:54.790339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94146b18-09f5-4734-99e6-ed5fe9836040 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:54.805047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94146b18-09f5-4734-99e6-ed5fe9836040 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:54.811186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:54.811834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:54.812121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:54.812405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:54.821663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:54.823405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1af218-1519-4ef6-b646-9846b65aa889 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:54.834539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 683/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:51:57.289450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1818-814f-4c57-bfb2-9db9d365be5d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:57.289970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1818-814f-4c57-bfb2-9db9d365be5d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:57.290069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1818-814f-4c57-bfb2-9db9d365be5d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:57.291426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 678/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:51:57.297564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf9af-2168-44db-bb46-285d2a05f15f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:57.298106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf9af-2168-44db-bb46-285d2a05f15f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:57.298467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf9af-2168-44db-bb46-285d2a05f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:57.322072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2accf9af-2168-44db-bb46-285d2a05f15f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:51:57.323371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2accf9af-2168-44db-bb46-285d2a05f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:51:57.334698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 684/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:51:57.380439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e1818-814f-4c57-bfb2-9db9d365be5d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:51:57.396420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e1818-814f-4c57-bfb2-9db9d365be5d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:51:57.403014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:51:57.403755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:51:57.404117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:51:57.407812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:51:57.419152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:51:57.421259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e36c5-ff66-4ab1-be4c-a60951ab56ed service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:51:57.432273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 679/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 12:52:00.152142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf51-b779-4d6a-9ee9-a2d42016e972 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:00.152625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf51-b779-4d6a-9ee9-a2d42016e972 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:00.152752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf51-b779-4d6a-9ee9-a2d42016e972 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:00.154328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 685/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:00.159663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ba7b-ea1b-4d55-8043-41aa5cd4edec None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:00.160097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ba7b-ea1b-4d55-8043-41aa5cd4edec None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:00.160225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ba7b-ea1b-4d55-8043-41aa5cd4edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:00.178838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7075ba7b-ea1b-4d55-8043-41aa5cd4edec None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:00.180070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7075ba7b-ea1b-4d55-8043-41aa5cd4edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:00.188693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 680/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:00.233846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aa8-e0d5-4dba-a1db-f77a13934d25 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:00.234158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aa8-e0d5-4dba-a1db-f77a13934d25 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:00.234435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aa8-e0d5-4dba-a1db-f77a13934d25 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:00.235843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 686/1366] 10.222.0.36 () {54 vars in 961 bytes} [Tue May 24 12:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:00.241104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1101-1ad2-4a94-867b-1d9c05dc6071 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:00.241397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1101-1ad2-4a94-867b-1d9c05dc6071 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:00.241678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1101-1ad2-4a94-867b-1d9c05dc6071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:00.260749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-032e1101-1ad2-4a94-867b-1d9c05dc6071 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:00.261960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-032e1101-1ad2-4a94-867b-1d9c05dc6071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:00.271415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 681/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Tue May 24 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:00.279111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b981aa8-e0d5-4dba-a1db-f77a13934d25 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:00.293918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b981aa8-e0d5-4dba-a1db-f77a13934d25 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:00.299346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:00.299979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:00.300263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:00.300534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:00.309384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:00.310987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab985-8c04-42e6-84ea-3e0e2c1b7a08 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:00.320717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 687/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 12:52:02.624417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2222-7238-4b7c-a8ef-b296f2f53da4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:02.625014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2222-7238-4b7c-a8ef-b296f2f53da4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:02.625014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a2222-7238-4b7c-a8ef-b296f2f53da4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:02.626423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 682/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:02.635655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef364e-efba-48a3-acd1-fba6e10f6e1e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:02.636143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef364e-efba-48a3-acd1-fba6e10f6e1e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:02.636247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef364e-efba-48a3-acd1-fba6e10f6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:02.655118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-45ef364e-efba-48a3-acd1-fba6e10f6e1e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:02.656317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-45ef364e-efba-48a3-acd1-fba6e10f6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:02.664474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 688/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:02.709020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a2222-7238-4b7c-a8ef-b296f2f53da4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:02.726069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a2222-7238-4b7c-a8ef-b296f2f53da4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:02.732495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:02.733169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:02.733454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:02.733733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:02.743793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:02.745457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b084f-80b4-4a02-b6ec-5983f1de0a62 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:02.756608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0be4-4c40-4c37-8455-7f786be7c3ee None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:02.757405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0be4-4c40-4c37-8455-7f786be7c3ee None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:02.757693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0be4-4c40-4c37-8455-7f786be7c3ee None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:02.759342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 689/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:52:02.759488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 683/1372] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:02.765854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98e4e-cc50-4f77-b6f7-106115524370 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:02.766311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98e4e-cc50-4f77-b6f7-106115524370 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:02.766696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca98e4e-cc50-4f77-b6f7-106115524370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:02.788816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5ca98e4e-cc50-4f77-b6f7-106115524370 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:02.790418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5ca98e4e-cc50-4f77-b6f7-106115524370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:02.810642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 690/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:03.114365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebdaf5-a022-468c-b471-7115df3bc38d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:03.114657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebdaf5-a022-468c-b471-7115df3bc38d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:03.115209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebdaf5-a022-468c-b471-7115df3bc38d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:03.116353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 684/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue May 24 12:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:03.123974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b171f-e73f-4de1-a39f-87cb4252dad6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:03.124398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b171f-e73f-4de1-a39f-87cb4252dad6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:03.124780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b171f-e73f-4de1-a39f-87cb4252dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:03.179730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3f4b171f-e73f-4de1-a39f-87cb4252dad6 None None] MFA Rules not processed for user `68d8d9ddbe0c4ebb920c126f0122ce33`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:03.181077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3f4b171f-e73f-4de1-a39f-87cb4252dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:03.247263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 691/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue May 24 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:03.255100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebdaf5-a022-468c-b471-7115df3bc38d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:03.266552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebdaf5-a022-468c-b471-7115df3bc38d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:03.270411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:03.271157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:03.271545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:03.271923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:03.282663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:03.284231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe6f1c-a220-47d2-bb1c-51f40c0dd709 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:03.295542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 685/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:05.027443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08968901-363b-492b-b01a-aff8f7270517 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:05.028006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08968901-363b-492b-b01a-aff8f7270517 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:05.028006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08968901-363b-492b-b01a-aff8f7270517 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:05.029369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 692/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:05.035220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc9ac-3d8f-43c6-9429-ef6da166e23c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:05.035742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc9ac-3d8f-43c6-9429-ef6da166e23c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:05.035836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc9ac-3d8f-43c6-9429-ef6da166e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:05.055497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0bcdc9ac-3d8f-43c6-9429-ef6da166e23c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:05.056792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0bcdc9ac-3d8f-43c6-9429-ef6da166e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:05.065702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 686/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:05.110317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08968901-363b-492b-b01a-aff8f7270517 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:05.125207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08968901-363b-492b-b01a-aff8f7270517 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:05.130707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:05.131358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:05.131644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:05.131922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:05.140457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:05.142068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d37b8-6c2a-489f-a83a-62206b0df61b service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:05.151793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 693/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:07.464908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b0fce-70e7-4dec-ae27-7ecb702c3f59 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:07.465467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b0fce-70e7-4dec-ae27-7ecb702c3f59 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:07.465467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b0fce-70e7-4dec-ae27-7ecb702c3f59 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:07.466906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 687/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:07.472386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce79be-ba6b-4293-82cc-3861713acf32 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:07.472831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce79be-ba6b-4293-82cc-3861713acf32 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:07.473218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce79be-ba6b-4293-82cc-3861713acf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:07.491709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b6ce79be-ba6b-4293-82cc-3861713acf32 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:07.493151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b6ce79be-ba6b-4293-82cc-3861713acf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:07.502232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 694/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:07.546679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b0fce-70e7-4dec-ae27-7ecb702c3f59 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:07.562019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b0fce-70e7-4dec-ae27-7ecb702c3f59 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:07.567644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:07.568285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:07.568572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:07.568853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:07.578065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:07.579837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950815d2-1bb5-4a58-a570-1da4e487076a service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:07.589712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 688/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:09.862940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe19ec9-3f1f-4313-94b8-eafb15cff293 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:09.863479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe19ec9-3f1f-4313-94b8-eafb15cff293 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:09.863791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe19ec9-3f1f-4313-94b8-eafb15cff293 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:09.866004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 695/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:09.871592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf98d0e-efbc-4f66-b219-60b9ad4f6c6c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:09.872528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf98d0e-efbc-4f66-b219-60b9ad4f6c6c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:09.872528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf98d0e-efbc-4f66-b219-60b9ad4f6c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:09.890603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4cf98d0e-efbc-4f66-b219-60b9ad4f6c6c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:09.891791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4cf98d0e-efbc-4f66-b219-60b9ad4f6c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:09.901983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 689/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:09.942760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe19ec9-3f1f-4313-94b8-eafb15cff293 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:09.957281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe19ec9-3f1f-4313-94b8-eafb15cff293 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:09.962963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:09.963768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:09.964228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:09.964701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:09.973605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:09.975427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032c78-7cd3-4d59-995e-cbb904629ad6 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:09.986620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 696/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:12.257985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e488-8040-4397-8cb1-606a2dff6fac None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:12.258549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e488-8040-4397-8cb1-606a2dff6fac None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:12.258549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5e488-8040-4397-8cb1-606a2dff6fac None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:12.259993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 690/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:12.266203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964ff1-6613-4d4c-8a6d-9f5c5e9881ed None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:12.266621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964ff1-6613-4d4c-8a6d-9f5c5e9881ed None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:12.266770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964ff1-6613-4d4c-8a6d-9f5c5e9881ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:12.286724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ec964ff1-6613-4d4c-8a6d-9f5c5e9881ed None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:12.287986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ec964ff1-6613-4d4c-8a6d-9f5c5e9881ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:12.296390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 697/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:12.343249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5e488-8040-4397-8cb1-606a2dff6fac None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:12.359635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5e488-8040-4397-8cb1-606a2dff6fac None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:12.365857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:12.366685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:12.366981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:12.367303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:12.379758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:12.381573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028ac76-5c0a-4f2d-b8eb-bfbf3104b7b2 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:12.393154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 691/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:14.616712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3da1-2ecb-45cf-9f6d-09c2129f157d None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:14.617265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3da1-2ecb-45cf-9f6d-09c2129f157d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:14.617265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff3da1-2ecb-45cf-9f6d-09c2129f157d None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:14.618743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 698/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:14.625258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fa768-79ac-4db1-9207-072aea3aa09d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:14.625688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fa768-79ac-4db1-9207-072aea3aa09d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:14.625821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fa768-79ac-4db1-9207-072aea3aa09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:14.643515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-329fa768-79ac-4db1-9207-072aea3aa09d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:14.644706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-329fa768-79ac-4db1-9207-072aea3aa09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:14.652653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 692/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 12:52:14.704036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff3da1-2ecb-45cf-9f6d-09c2129f157d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:14.719414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff3da1-2ecb-45cf-9f6d-09c2129f157d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:14.725405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:14.726025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:14.726342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:14.726625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:14.735780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:14.737358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7ff3-1ef6-4683-aba4-fcf1c99f1dee service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:14.748537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 699/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:16.996648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5f66-963e-4a4c-a485-d39e01888e72 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:16.997357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5f66-963e-4a4c-a485-d39e01888e72 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:16.997357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a5f66-963e-4a4c-a485-d39e01888e72 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:16.998647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 693/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:17.004185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3bd-7b65-4177-a2d2-bcd2bfc637a1 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:17.004637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3bd-7b65-4177-a2d2-bcd2bfc637a1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:17.004964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3bd-7b65-4177-a2d2-bcd2bfc637a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:17.026243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8c12f3bd-7b65-4177-a2d2-bcd2bfc637a1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:17.028444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8c12f3bd-7b65-4177-a2d2-bcd2bfc637a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:17.038951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 700/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:17.088148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a5f66-963e-4a4c-a485-d39e01888e72 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:17.102550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a5f66-963e-4a4c-a485-d39e01888e72 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:17.108227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:17.108865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:17.109148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:17.109425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:17.117557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:17.119502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ead6-86d6-4c5c-b01a-7bfae964595f service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:17.129846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 694/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:19.400461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98f48-42c5-4a18-8c48-81ed1d0a41a2 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:19.401071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98f48-42c5-4a18-8c48-81ed1d0a41a2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:19.401181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98f48-42c5-4a18-8c48-81ed1d0a41a2 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:19.404244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 701/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:19.410448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d10d4-fe53-4a64-9adf-0e64e05ad0fb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:19.410448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d10d4-fe53-4a64-9adf-0e64e05ad0fb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:19.410448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d10d4-fe53-4a64-9adf-0e64e05ad0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:19.430515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e71d10d4-fe53-4a64-9adf-0e64e05ad0fb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:19.431709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e71d10d4-fe53-4a64-9adf-0e64e05ad0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:19.439473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 695/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:19.495602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e98f48-42c5-4a18-8c48-81ed1d0a41a2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:19.504101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=87 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:19.511934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e98f48-42c5-4a18-8c48-81ed1d0a41a2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:19.517433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:19.518134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:19.518432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:19.518709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:19.527708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:19.529770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4521228-a828-4358-8689-ed7d2d7b47f2 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:19.539496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 702/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:21.817519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc8b5-a53f-4f7c-a3eb-fc2875a9015f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:21.818144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc8b5-a53f-4f7c-a3eb-fc2875a9015f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:21.818144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc8b5-a53f-4f7c-a3eb-fc2875a9015f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:21.819508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 696/1398] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:21.824985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302ca6-72c5-4789-8b83-7d5ac453841e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:21.825457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302ca6-72c5-4789-8b83-7d5ac453841e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:21.825568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42302ca6-72c5-4789-8b83-7d5ac453841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:21.844240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-42302ca6-72c5-4789-8b83-7d5ac453841e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:21.845432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-42302ca6-72c5-4789-8b83-7d5ac453841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:21.853249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 703/1399] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:21.898644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fc8b5-a53f-4f7c-a3eb-fc2875a9015f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:21.913801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fc8b5-a53f-4f7c-a3eb-fc2875a9015f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:21.919332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:21.919971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:21.920282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:21.920559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:21.928955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:21.930606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8d17b-9a0d-45d8-8791-33e8f49c3bde service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:21.940273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 697/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:22.559319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf6ec-e86b-4a12-90b5-fc80fe73b3d3 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:22.559529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf6ec-e86b-4a12-90b5-fc80fe73b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:22.559816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf6ec-e86b-4a12-90b5-fc80fe73b3d3 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:22.561241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 704/1401] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:22.566822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0aab-86c5-42c0-9f3f-a11010807752 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:22.567108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0aab-86c5-42c0-9f3f-a11010807752 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:22.567381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f0aab-86c5-42c0-9f3f-a11010807752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:22.585237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7c4f0aab-86c5-42c0-9f3f-a11010807752 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:22.586452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7c4f0aab-86c5-42c0-9f3f-a11010807752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:22.595068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 698/1402] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:22.650400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3e10-8b02-4abd-9ded-1afa203e24f5 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:22.650752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3e10-8b02-4abd-9ded-1afa203e24f5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:22.651026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3e10-8b02-4abd-9ded-1afa203e24f5 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:22.653094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 705/1403] 10.222.0.36 () {54 vars in 962 bytes} [Tue May 24 12:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:22.658253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bb63-a808-413d-8795-a43c3e4f2863 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:22.658548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bb63-a808-413d-8795-a43c3e4f2863 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:22.658827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545bb63-a808-413d-8795-a43c3e4f2863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:22.664344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:22.707363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e545bb63-a808-413d-8795-a43c3e4f2863 None None] MFA Rules not processed for user `c58212e67bed45fc9c573568eea16b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:22.708567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e545bb63-a808-413d-8795-a43c3e4f2863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:22.768328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 699/1404] 10.222.0.36 () {58 vars in 1059 bytes} [Tue May 24 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:22.776379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3e10-8b02-4abd-9ded-1afa203e24f5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:22.787698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c3e10-8b02-4abd-9ded-1afa203e24f5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:22.791136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:22.791766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:22.792045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:22.792315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:22.801223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:22.802683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ad9a7-5b05-4f0f-ae73-6b88483db2b0 service glance] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:22.812444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 706/1405] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:23.331813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256de5-44c7-465a-81ec-f6fbb6f64ed8 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:23.332286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256de5-44c7-465a-81ec-f6fbb6f64ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:23.332379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256de5-44c7-465a-81ec-f6fbb6f64ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:23.381166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-20256de5-44c7-465a-81ec-f6fbb6f64ed8 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:23.382388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-20256de5-44c7-465a-81ec-f6fbb6f64ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:23.445876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 700/1406] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:23.490054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72213-bef1-4b97-b877-2bb680b415d9 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:23.490549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72213-bef1-4b97-b877-2bb680b415d9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:23.490651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e72213-bef1-4b97-b877-2bb680b415d9 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:23.492040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 707/1407] 10.222.0.36 () {54 vars in 942 bytes} [Tue May 24 12:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:23.499252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426ca5-1f22-44ef-ba8a-5000667cd918 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:23.499544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426ca5-1f22-44ef-ba8a-5000667cd918 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:23.499827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426ca5-1f22-44ef-ba8a-5000667cd918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:23.547474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ea426ca5-1f22-44ef-ba8a-5000667cd918 None None] MFA Rules not processed for user `2871bcf4578040648c19fb6eb9464261`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:23.548687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ea426ca5-1f22-44ef-ba8a-5000667cd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:23.568933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:23.619872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 701/1408] 10.222.0.36 () {58 vars in 1039 bytes} [Tue May 24 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:23.629838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e72213-bef1-4b97-b877-2bb680b415d9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:23.644066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e72213-bef1-4b97-b877-2bb680b415d9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:23.648885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:23.649512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:23.649791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:23.650066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:23.659075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:23.660655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa2287-d5af-406c-8489-845cf632edd4 service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:23.668871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 708/1409] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 12:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 12:52:33.617130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=21 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:33.665476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=20 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:52:47.108776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e7bd6-b33a-43e2-9624-447c44d92f6a None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:47.109407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e7bd6-b33a-43e2-9624-447c44d92f6a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:47.109407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e7bd6-b33a-43e2-9624-447c44d92f6a None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:47.110842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 702/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue May 24 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:47.115852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7f43-89e1-462d-8874-f54ef25787bf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:47.116316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7f43-89e1-462d-8874-f54ef25787bf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:47.116448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7f43-89e1-462d-8874-f54ef25787bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:47.134883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-dfda7f43-89e1-462d-8874-f54ef25787bf None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:47.136087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-dfda7f43-89e1-462d-8874-f54ef25787bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:47.144744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 709/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 24 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 12:52:47.159672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c9540-402a-481c-aa97-5b9a7598e41f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:47.160053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c9540-402a-481c-aa97-5b9a7598e41f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:47.160337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c9540-402a-481c-aa97-5b9a7598e41f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:47.161777 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 703/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue May 24 12:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:52:47.166219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c32ac-d272-487f-9582-65957fa8873a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:47.166516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c32ac-d272-487f-9582-65957fa8873a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:47.166800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c32ac-d272-487f-9582-65957fa8873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:47.186174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-4e1c32ac-d272-487f-9582-65957fa8873a None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:47.187371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4e1c32ac-d272-487f-9582-65957fa8873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:47.196353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 710/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 24 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 12:52:49.928743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732567ed-8753-4851-88c6-5ac60c1433c7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:49.929309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732567ed-8753-4851-88c6-5ac60c1433c7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:49.929309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732567ed-8753-4851-88c6-5ac60c1433c7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:49.930765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:49.936354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a519c-ed82-474d-a399-e5f4186f118e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:49.936762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a519c-ed82-474d-a399-e5f4186f118e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:49.937014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a519c-ed82-474d-a399-e5f4186f118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:49.955642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-735a519c-ed82-474d-a399-e5f4186f118e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:49.956844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-735a519c-ed82-474d-a399-e5f4186f118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:49.965339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:50.008445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732567ed-8753-4851-88c6-5ac60c1433c7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:50.023553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732567ed-8753-4851-88c6-5ac60c1433c7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:50.029457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:50.030094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:50.030409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:50.030691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:50.038766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:50.040358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6f569-dd70-4829-b2dc-892e7ede1a98 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:50.049704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 705/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:51.020107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549954f-c7a5-4579-bdb7-e166e89e625f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:51.020700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549954f-c7a5-4579-bdb7-e166e89e625f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:51.020700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549954f-c7a5-4579-bdb7-e166e89e625f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:51.022074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 12:52:51.026975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d4b4-a946-47a3-810b-bfc1e3db9d9d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:51.027782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d4b4-a946-47a3-810b-bfc1e3db9d9d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:51.028061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d4b4-a946-47a3-810b-bfc1e3db9d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:51.046081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6c21d4b4-a946-47a3-810b-bfc1e3db9d9d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:51.047648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6c21d4b4-a946-47a3-810b-bfc1e3db9d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:51.055293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:51.216294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549954f-c7a5-4579-bdb7-e166e89e625f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:51.230980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549954f-c7a5-4579-bdb7-e166e89e625f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:51.236404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:51.237034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:51.237314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:51.237588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:51.245553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:51.248204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb55404-83c0-4991-a2e7-f7e27c283188 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:51.257373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 713/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:52.189302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5fed-8d4d-408d-8cb0-f8ef0918e4d8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:52.189860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5fed-8d4d-408d-8cb0-f8ef0918e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:52.189860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5fed-8d4d-408d-8cb0-f8ef0918e4d8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:52.191320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:52.196212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4a19-4654-4c3c-9da0-e427e5d82068 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:52.196631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4a19-4654-4c3c-9da0-e427e5d82068 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:52.196770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4a19-4654-4c3c-9da0-e427e5d82068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:52.215476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fc6a4a19-4654-4c3c-9da0-e427e5d82068 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:52.216605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fc6a4a19-4654-4c3c-9da0-e427e5d82068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:52.224293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:52.376369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5fed-8d4d-408d-8cb0-f8ef0918e4d8 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:52.391212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5fed-8d4d-408d-8cb0-f8ef0918e4d8 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:52.396655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:52.397290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:52.397577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:52.397855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:52.406261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:52.407867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89895d51-837b-4a97-b5c9-a1495b3444a6 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:52.417380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 708/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:53.344956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d21c5-cb6e-4eeb-92e4-b98e7fc85a27 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:53.345493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d21c5-cb6e-4eeb-92e4-b98e7fc85a27 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:53.345493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d21c5-cb6e-4eeb-92e4-b98e7fc85a27 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:53.346934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:53.351787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3816d-bf35-409e-86a2-3b713ce7fbbd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:53.352218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3816d-bf35-409e-86a2-3b713ce7fbbd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:53.352379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3816d-bf35-409e-86a2-3b713ce7fbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:53.370320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-96e3816d-bf35-409e-86a2-3b713ce7fbbd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:53.372374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-96e3816d-bf35-409e-86a2-3b713ce7fbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:53.380219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:53.529583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d21c5-cb6e-4eeb-92e4-b98e7fc85a27 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:53.544308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d21c5-cb6e-4eeb-92e4-b98e7fc85a27 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:53.549663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:53.550334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:53.550624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:53.550903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:53.559675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:53.561253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baae428-7a09-41f1-b895-09f9234717c3 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:53.570691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 716/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:54.473985 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0539e-9587-471b-8826-28dd7aaea2f2 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:54.474544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0539e-9587-471b-8826-28dd7aaea2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:54.474651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0539e-9587-471b-8826-28dd7aaea2f2 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:54.476010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:54.481270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40845c0-08ff-4fc6-992c-7c3e8dabd329 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:54.481737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40845c0-08ff-4fc6-992c-7c3e8dabd329 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:54.481833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40845c0-08ff-4fc6-992c-7c3e8dabd329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:54.500097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d40845c0-08ff-4fc6-992c-7c3e8dabd329 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:54.501468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d40845c0-08ff-4fc6-992c-7c3e8dabd329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:54.510045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:54.659587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0539e-9587-471b-8826-28dd7aaea2f2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:54.673999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0539e-9587-471b-8826-28dd7aaea2f2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:54.679318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:54.679946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:54.680225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:54.680496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:54.689695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:54.691313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8267a1-dee9-4e5c-a7c8-8cf409d7f831 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:54.701897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 711/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:55.553937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18592db-7b23-46e4-a670-44a8e6564785 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:55.554827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18592db-7b23-46e4-a670-44a8e6564785 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:55.555119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18592db-7b23-46e4-a670-44a8e6564785 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:55.556573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:55.562011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ed50-fdde-4e16-b332-87b3c0757c6b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:55.562453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ed50-fdde-4e16-b332-87b3c0757c6b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:55.562615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ed50-fdde-4e16-b332-87b3c0757c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:55.580996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bd43ed50-fdde-4e16-b332-87b3c0757c6b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:55.582223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bd43ed50-fdde-4e16-b332-87b3c0757c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:55.590008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:55.739001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18592db-7b23-46e4-a670-44a8e6564785 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:55.753884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18592db-7b23-46e4-a670-44a8e6564785 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:55.759227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:55.760137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:55.760422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:55.760692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:55.768657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:55.770255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa63219-56dd-49a8-8c27-25ecdb1faf4b service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:55.779730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 719/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:56.629872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1174ff-4077-40d7-88d8-19044308cb22 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:56.630430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1174ff-4077-40d7-88d8-19044308cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:56.630548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1174ff-4077-40d7-88d8-19044308cb22 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:56.631898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:56.637542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832d79-1b68-4879-ae33-07231e27542d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:56.637935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832d79-1b68-4879-ae33-07231e27542d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:56.638202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832d79-1b68-4879-ae33-07231e27542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:56.656405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ce832d79-1b68-4879-ae33-07231e27542d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:56.657592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ce832d79-1b68-4879-ae33-07231e27542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:56.665247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:56.815077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1174ff-4077-40d7-88d8-19044308cb22 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:56.829947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1174ff-4077-40d7-88d8-19044308cb22 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:56.835500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:56.836139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:56.836423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:56.836698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:56.844954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:56.846592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e50d-26bb-4bda-8f36-6873cf2c290c service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:56.856014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 714/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:57.706058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d545-11b2-4b30-b502-01a1cffaf58f None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:57.706595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d545-11b2-4b30-b502-01a1cffaf58f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:57.706595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d545-11b2-4b30-b502-01a1cffaf58f None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:57.708071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:57.713191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced137f7-d7d9-408d-a95b-c42213e6a272 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:57.713577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced137f7-d7d9-408d-a95b-c42213e6a272 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:57.713737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced137f7-d7d9-408d-a95b-c42213e6a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:57.733419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ced137f7-d7d9-408d-a95b-c42213e6a272 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:57.734635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ced137f7-d7d9-408d-a95b-c42213e6a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:57.742277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:52:57.893168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1d545-11b2-4b30-b502-01a1cffaf58f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:57.908367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1d545-11b2-4b30-b502-01a1cffaf58f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:57.913778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:57.914442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:57.914730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:57.915007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:57.923051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:57.924621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a017c57-ca14-4f01-bfe4-657e3a371f04 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:57.933913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 722/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:52:58.866662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febecbf-b3ac-4a2b-ab76-515c16ecf99d None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:58.867240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febecbf-b3ac-4a2b-ab76-515c16ecf99d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:58.867240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febecbf-b3ac-4a2b-ab76-515c16ecf99d None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:58.868649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:52:58.875643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad224a-c71b-4c35-813a-a57bb136ebd4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:58.876128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad224a-c71b-4c35-813a-a57bb136ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:58.876343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad224a-c71b-4c35-813a-a57bb136ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:58.894882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a6ad224a-c71b-4c35-813a-a57bb136ebd4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:52:58.896107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a6ad224a-c71b-4c35-813a-a57bb136ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:52:58.904168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 12:52:59.065847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febecbf-b3ac-4a2b-ab76-515c16ecf99d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:52:59.082384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febecbf-b3ac-4a2b-ab76-515c16ecf99d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:52:59.087776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:52:59.088448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:52:59.088735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:52:59.089014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:52:59.099044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:52:59.100846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb7ce7-de52-436a-a245-172caba9edd2 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:52:59.111425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 717/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:01.222183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323514ca-f9cb-4f27-8706-873a3231ef36 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:01.222803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323514ca-f9cb-4f27-8706-873a3231ef36 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:01.222803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323514ca-f9cb-4f27-8706-873a3231ef36 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:01.224165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:01.229551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441eca-0368-4669-a897-2b821dfdd156 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:01.230509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441eca-0368-4669-a897-2b821dfdd156 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:01.231010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441eca-0368-4669-a897-2b821dfdd156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:01.249222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1d441eca-0368-4669-a897-2b821dfdd156 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:01.250456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1d441eca-0368-4669-a897-2b821dfdd156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:01.258154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:01.296459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323514ca-f9cb-4f27-8706-873a3231ef36 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:01.306933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323514ca-f9cb-4f27-8706-873a3231ef36 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:01.310645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:01.311286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:01.311568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:01.311854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:01.321264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:01.322718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c7964-f000-45a7-b62d-95673716b270 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:01.332072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 725/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:03.751508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafa3b-5cc4-4a01-a216-52d4bc7873f7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:03.752062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafa3b-5cc4-4a01-a216-52d4bc7873f7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:03.752062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafa3b-5cc4-4a01-a216-52d4bc7873f7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:03.753447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:03.758648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b143e6-afd9-4946-86d3-2367458eecbd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:03.759081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b143e6-afd9-4946-86d3-2367458eecbd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:03.759218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b143e6-afd9-4946-86d3-2367458eecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:03.777530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-31b143e6-afd9-4946-86d3-2367458eecbd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:03.778859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-31b143e6-afd9-4946-86d3-2367458eecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:03.786560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:03.823946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafa3b-5cc4-4a01-a216-52d4bc7873f7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:03.834585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafa3b-5cc4-4a01-a216-52d4bc7873f7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:03.838002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:03.838659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:03.838940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:03.839214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:03.848881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:03.850339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111a440-174e-4ba7-8002-e2d5a91a3c00 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:03.860331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 720/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:06.384607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394badd-eed5-4ac3-8105-213eb433203e None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:06.385168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394badd-eed5-4ac3-8105-213eb433203e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:06.385168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394badd-eed5-4ac3-8105-213eb433203e None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:06.387321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:06.392726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92637f9-64d0-4f6a-ae3e-dff86bf3710d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:06.393142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92637f9-64d0-4f6a-ae3e-dff86bf3710d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:06.393289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92637f9-64d0-4f6a-ae3e-dff86bf3710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:06.412757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f92637f9-64d0-4f6a-ae3e-dff86bf3710d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:06.413964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f92637f9-64d0-4f6a-ae3e-dff86bf3710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:06.422482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:06.460834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394badd-eed5-4ac3-8105-213eb433203e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:06.471995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394badd-eed5-4ac3-8105-213eb433203e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:06.475529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:06.476168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:06.476454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:06.476730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:06.485502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:06.486959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58664b-20fb-4af3-9691-c5e8cee7fc76 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:06.496174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 728/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:08.854245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dff3-abd8-4681-b997-a74c215c148f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:08.854842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dff3-abd8-4681-b997-a74c215c148f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:08.854842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dff3-abd8-4681-b997-a74c215c148f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:08.856343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:08.861670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda08f8-7617-4c19-ae89-80556337e1a9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:08.862103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda08f8-7617-4c19-ae89-80556337e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:08.862271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda08f8-7617-4c19-ae89-80556337e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:08.880660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2dda08f8-7617-4c19-ae89-80556337e1a9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:08.881853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2dda08f8-7617-4c19-ae89-80556337e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:08.890838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:08.929016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55dff3-abd8-4681-b997-a74c215c148f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:08.940107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55dff3-abd8-4681-b997-a74c215c148f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:08.943628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:08.944263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:08.944549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:08.944825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:08.953748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:08.955333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd12d4-e255-43cc-9ebe-ae2076a5f45a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:08.965113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 723/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:11.291114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240b01-1874-4dfa-b745-b7851470d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:11.291702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240b01-1874-4dfa-b745-b7851470d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:11.291702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb240b01-1874-4dfa-b745-b7851470d6f0 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:11.293625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:11.299140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5902-fa00-4cdb-a785-79b008f8ffa4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:11.299541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5902-fa00-4cdb-a785-79b008f8ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:11.299697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a5902-fa00-4cdb-a785-79b008f8ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:11.317482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-425a5902-fa00-4cdb-a785-79b008f8ffa4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:11.318716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-425a5902-fa00-4cdb-a785-79b008f8ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:11.326595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:11.364158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb240b01-1874-4dfa-b745-b7851470d6f0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:11.375250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb240b01-1874-4dfa-b745-b7851470d6f0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:11.378868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:11.379504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:11.379778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:11.380047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:11.390156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:11.391570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153064-c35a-4cef-bd12-535e68031452 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:11.400937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 731/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:13.668686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d511fc-e5ba-4b17-8094-05b5f755ed09 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:13.669211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d511fc-e5ba-4b17-8094-05b5f755ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:13.669211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d511fc-e5ba-4b17-8094-05b5f755ed09 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:13.670615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:13.675940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c57e3-d129-4842-aed6-b3a3ead4be49 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:13.676341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c57e3-d129-4842-aed6-b3a3ead4be49 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:13.676507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c57e3-d129-4842-aed6-b3a3ead4be49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:13.682553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=70 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:13.698091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-dd3c57e3-d129-4842-aed6-b3a3ead4be49 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:13.699391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-dd3c57e3-d129-4842-aed6-b3a3ead4be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:13.707203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:13.751908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d511fc-e5ba-4b17-8094-05b5f755ed09 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:13.757281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=64 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:13.763059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d511fc-e5ba-4b17-8094-05b5f755ed09 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:13.766613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:13.767250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:13.767534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:13.767810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:13.776699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:13.778310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f0842-5f55-4c5b-bbd6-0f5df8723567 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:13.787625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 726/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:16.039423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf86ea-52b9-4f4f-8a23-190169d574aa None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:16.039950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf86ea-52b9-4f4f-8a23-190169d574aa None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:16.040068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf86ea-52b9-4f4f-8a23-190169d574aa None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:16.041393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:16.047134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef0ed-2989-45a6-b6c4-5bf2ad8a108c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:16.047551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef0ed-2989-45a6-b6c4-5bf2ad8a108c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:16.047692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ef0ed-2989-45a6-b6c4-5bf2ad8a108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:16.065676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9f4ef0ed-2989-45a6-b6c4-5bf2ad8a108c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:16.066901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9f4ef0ed-2989-45a6-b6c4-5bf2ad8a108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:16.074720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:16.112888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf86ea-52b9-4f4f-8a23-190169d574aa None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:16.124396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf86ea-52b9-4f4f-8a23-190169d574aa None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:16.127955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:16.128588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:16.128873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:16.129151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:16.137999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:16.139474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ead85-4d63-46fa-b01f-8f6e3345f7c0 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:16.148754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 734/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:18.415269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0882b-c94c-41fc-8759-83a5227e3ab1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:18.415721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0882b-c94c-41fc-8759-83a5227e3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:18.415834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0882b-c94c-41fc-8759-83a5227e3ab1 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:18.417280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:18.423845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83edaf-e102-4d1f-a3d9-462aceea11b7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:18.424241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83edaf-e102-4d1f-a3d9-462aceea11b7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:18.424421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83edaf-e102-4d1f-a3d9-462aceea11b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:18.442735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1c83edaf-e102-4d1f-a3d9-462aceea11b7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:18.443916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1c83edaf-e102-4d1f-a3d9-462aceea11b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:18.452169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:18.490644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0882b-c94c-41fc-8759-83a5227e3ab1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:18.502411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0882b-c94c-41fc-8759-83a5227e3ab1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:18.505995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:18.506656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:18.506942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:18.507220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:18.516213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:18.517646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5f5ad-d307-405f-9f94-584052377a3c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:18.527511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 729/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 12:53:20.744605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b3b6-0ab1-4634-9393-18abe5d83eca None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:20.745118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b3b6-0ab1-4634-9393-18abe5d83eca None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:20.745118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b3b6-0ab1-4634-9393-18abe5d83eca None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:20.746993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:20.752459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7847b-5509-4dd6-b6ce-83a0a3ec3528 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:20.752866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7847b-5509-4dd6-b6ce-83a0a3ec3528 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:20.753020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7847b-5509-4dd6-b6ce-83a0a3ec3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:20.771074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-48a7847b-5509-4dd6-b6ce-83a0a3ec3528 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:20.772268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-48a7847b-5509-4dd6-b6ce-83a0a3ec3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:20.780609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:20.816295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b3b6-0ab1-4634-9393-18abe5d83eca None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:20.827554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b3b6-0ab1-4634-9393-18abe5d83eca None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:20.831069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:20.831703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:20.831988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:20.832265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:20.841069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:20.842521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f601cf-1fb4-48aa-aa5c-98f08b46bb2b service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:20.851777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 737/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:23.079471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e5d-21f9-4133-82d7-8ff3ea46aab3 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:23.080035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e5d-21f9-4133-82d7-8ff3ea46aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:23.080035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e5d-21f9-4133-82d7-8ff3ea46aab3 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:23.081444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:23.086907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331538c-238e-44e9-b4c9-1af926c8020e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:23.087283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331538c-238e-44e9-b4c9-1af926c8020e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:23.087464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331538c-238e-44e9-b4c9-1af926c8020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:23.106458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1331538c-238e-44e9-b4c9-1af926c8020e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:23.107664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1331538c-238e-44e9-b4c9-1af926c8020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:23.115411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:23.152835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc1e5d-21f9-4133-82d7-8ff3ea46aab3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:23.163317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc1e5d-21f9-4133-82d7-8ff3ea46aab3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:23.166740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:23.167418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:23.168734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:23.169014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:23.177776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:23.179234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88f63-93c4-4daf-928e-1cdfad721c1b service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:23.188864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 732/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:33.100644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=20 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:33.184796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=23 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:53:56.230775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5723-7714-4be1-83bc-3fba91c14951 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:56.231370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5723-7714-4be1-83bc-3fba91c14951 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:56.231370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5723-7714-4be1-83bc-3fba91c14951 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:56.232880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 739/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:56.237957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9392c6-78d7-4a79-8c39-978c2bd0a2f9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:56.238412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9392c6-78d7-4a79-8c39-978c2bd0a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:56.238556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9392c6-78d7-4a79-8c39-978c2bd0a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:56.257212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bb9392c6-78d7-4a79-8c39-978c2bd0a2f9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:56.258381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb9392c6-78d7-4a79-8c39-978c2bd0a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:56.267071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 733/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:56.313015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc2bf-96df-4dc6-a29a-b0effc269e2b None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:56.313304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc2bf-96df-4dc6-a29a-b0effc269e2b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:56.313585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc2bf-96df-4dc6-a29a-b0effc269e2b None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:56.315028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 740/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue May 24 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:56.319796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2fec-2829-43ce-a9ad-d004aec6bedf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:56.320087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2fec-2829-43ce-a9ad-d004aec6bedf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:56.320369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d2fec-2829-43ce-a9ad-d004aec6bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:56.339103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-821d2fec-2829-43ce-a9ad-d004aec6bedf None None] MFA Rules not processed for user `c58212e67bed45fc9c573568eea16b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:56.340361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-821d2fec-2829-43ce-a9ad-d004aec6bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:56.346772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 734/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue May 24 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:56.353857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc2bf-96df-4dc6-a29a-b0effc269e2b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:56.364269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc2bf-96df-4dc6-a29a-b0effc269e2b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:56.368723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:56.369359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:56.369637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:56.369911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:56.379942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:56.381357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3b16-3004-4de7-878e-4784fcf9d6e4 service glance] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:56.391604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 741/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:53:58.699782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26931-31e4-4407-81f4-734124471291 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:58.700335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26931-31e4-4407-81f4-734124471291 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:58.700335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e26931-31e4-4407-81f4-734124471291 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:58.701623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 735/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:53:58.708140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79638-8a3b-4841-aa31-b631d7cda8f6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:58.708612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79638-8a3b-4841-aa31-b631d7cda8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:58.708722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b79638-8a3b-4841-aa31-b631d7cda8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:58.730656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e2b79638-8a3b-4841-aa31-b631d7cda8f6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:53:58.731876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e2b79638-8a3b-4841-aa31-b631d7cda8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:53:58.739842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 742/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:53:58.766318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26931-31e4-4407-81f4-734124471291 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:53:58.781812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e26931-31e4-4407-81f4-734124471291 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:53:58.786697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:53:58.787391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:53:58.787900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:53:58.788406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:53:58.789463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:53:58.791326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:53:58.791326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 12:53:58.791326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 12:53:58.792979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766d036-5930-4a1e-aeed-165111a86368 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:53:58.819608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 736/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue May 24 12:53:58 2022] GET /identity/v3/projects => generated 2553 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:54:01.047802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d11e-6e1e-4f8a-830b-6da9f72b6c81 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:01.048367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d11e-6e1e-4f8a-830b-6da9f72b6c81 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:01.048367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d11e-6e1e-4f8a-830b-6da9f72b6c81 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:01.049773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 743/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:54:01.055060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938e31-59b1-436b-afd3-23a84ad7b1e4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:01.055479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938e31-59b1-436b-afd3-23a84ad7b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:01.055625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e938e31-59b1-436b-afd3-23a84ad7b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:01.074333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0e938e31-59b1-436b-afd3-23a84ad7b1e4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:54:01.075545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0e938e31-59b1-436b-afd3-23a84ad7b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:54:01.083357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 737/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:54:01.126556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d11e-6e1e-4f8a-830b-6da9f72b6c81 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:54:01.140994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d11e-6e1e-4f8a-830b-6da9f72b6c81 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:54:01.146422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:54:01.147055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:01.147340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:01.147617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:01.155879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:54:01.157457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13a5b4-4b24-4aea-b6ff-74010ecae358 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:54:01.166712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 744/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:54:03.545196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd607bd9-132c-4eb6-9da7-8d4de2026c86 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:03.545720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd607bd9-132c-4eb6-9da7-8d4de2026c86 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:03.545819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd607bd9-132c-4eb6-9da7-8d4de2026c86 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:03.547213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 738/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:54:03.552395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25733-975e-42db-bbc0-6f8a102c5ca8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:03.552824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25733-975e-42db-bbc0-6f8a102c5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:03.552965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25733-975e-42db-bbc0-6f8a102c5ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:03.570948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-eec25733-975e-42db-bbc0-6f8a102c5ca8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:54:03.572143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-eec25733-975e-42db-bbc0-6f8a102c5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:54:03.580646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 745/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:54:03.615858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd607bd9-132c-4eb6-9da7-8d4de2026c86 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:54:03.627934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd607bd9-132c-4eb6-9da7-8d4de2026c86 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:54:03.631499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:54:03.632136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:03.632422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:03.632701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:03.642274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:54:03.643718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83d37-e258-40d3-8555-bb7a18e68f3d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:54:03.653180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 739/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:54:05.917608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ae7a-6ee0-49ac-bc61-06a9a87ac147 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:05.918191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ae7a-6ee0-49ac-bc61-06a9a87ac147 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:05.918191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ae7a-6ee0-49ac-bc61-06a9a87ac147 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:05.919602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 746/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:54:05.924764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31578b2-7d13-45ea-984a-8fe8aa96651d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:05.925205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31578b2-7d13-45ea-984a-8fe8aa96651d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:05.925325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31578b2-7d13-45ea-984a-8fe8aa96651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:05.943776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c31578b2-7d13-45ea-984a-8fe8aa96651d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:54:05.944974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c31578b2-7d13-45ea-984a-8fe8aa96651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:54:05.953495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 740/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:54:05.991399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ae7a-6ee0-49ac-bc61-06a9a87ac147 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:54:06.002868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ae7a-6ee0-49ac-bc61-06a9a87ac147 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:54:06.006803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:54:06.007441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:06.007731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:06.008011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:06.017552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:54:06.019010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239670d-d3bb-46fb-b827-d96cdeefb3ef service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:54:06.028513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 747/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:54:08.345139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134a95-14f4-4e9f-b89d-3bb613449626 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:08.345786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134a95-14f4-4e9f-b89d-3bb613449626 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:08.345786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03134a95-14f4-4e9f-b89d-3bb613449626 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:08.347162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 741/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:54:08.352316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bba7-0e10-4278-8cf6-21cd98415527 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:08.352768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bba7-0e10-4278-8cf6-21cd98415527 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:08.352877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5bba7-0e10-4278-8cf6-21cd98415527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:08.370986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-80c5bba7-0e10-4278-8cf6-21cd98415527 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:54:08.372430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-80c5bba7-0e10-4278-8cf6-21cd98415527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:54:08.380223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 748/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:54:08.421710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134a95-14f4-4e9f-b89d-3bb613449626 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:54:08.432366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03134a95-14f4-4e9f-b89d-3bb613449626 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:54:08.436477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:54:08.437106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:08.437389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:08.437665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:08.446394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:54:08.447830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2a4e-5bc3-4c41-a80c-b834b5220935 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:54:08.457241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 742/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:54:10.850567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ee78a-3ea4-4d26-b189-b2954acfa003 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:10.851122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ee78a-3ea4-4d26-b189-b2954acfa003 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:10.851122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ee78a-3ea4-4d26-b189-b2954acfa003 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:10.852510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 749/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue May 24 12:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:54:10.858690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aefa-4ad2-43db-9e22-37ebb60a1e10 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:10.859143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aefa-4ad2-43db-9e22-37ebb60a1e10 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:10.859250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aefa-4ad2-43db-9e22-37ebb60a1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:10.878818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-51b3aefa-4ad2-43db-9e22-37ebb60a1e10 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:54:10.880019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-51b3aefa-4ad2-43db-9e22-37ebb60a1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:54:10.887918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 743/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue May 24 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:54:10.926484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ee78a-3ea4-4d26-b189-b2954acfa003 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:54:10.937970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ee78a-3ea4-4d26-b189-b2954acfa003 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:54:10.941542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:54:10.942136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:54:10.942420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:54:10.942691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:54:10.951757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:54:10.953164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22418f1-2072-48ae-9eaf-44963545c65e service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:54:10.962256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 750/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:54:20.872493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=33 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:54:20.958293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=33 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:56:15.879043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:15.879632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:15.879632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:15.897991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:56:15.899214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:15.906922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 744/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:56:15.916700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:15.917195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:15.917311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:15.935796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:56:15.936991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:15.944730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 751/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:56:15.949338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:15.958847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20e971-83e2-4575-848d-c4fd181e3f2d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:15.963342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:15.963990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:15.964273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:15.964548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:15.965278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 12:56:15.965584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:15.966638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:15.966638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 12:56:15.966638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 12:56:15.967525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:15.979445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 745/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 12:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:56:15.987383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:15.997357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa7261-2a4d-46cf-a28d-63a2611607f8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.001919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.002601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.002886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.003160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.003849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.005615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.005615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 12:56:16.005615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 12:56:16.006859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.043198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 752/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 12:56:15 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 12:56:16.047453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.058383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d656-526f-46b0-87fd-72f9614783c9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.114965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.115648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.115939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.116193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.117068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.119505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.119505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 12:56:16.119505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 12:56:16.120487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.140464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 746/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 12:56:16 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 12:56:16.144564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.154892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b220f-cdb1-48ad-b899-c0664b6e7abc admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.159413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.160073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.160357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.160664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.161385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.162425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.162425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 12:56:16.162425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 12:56:16.163373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.177075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 753/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 12:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 12:56:16.181755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.191604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829146e8-f706-44b8-9750-6d3b0c89b3ee admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.196829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.197494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.197798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.198084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.198850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.199904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.199904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 12:56:16.199904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 12:56:16.200794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a541ce-c075-4ab0-a138-fccbefb28a87 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.215539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 747/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 12:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 12:56:16.219754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.230423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666063-4d16-4cab-9bbf-f7b550b02e06 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.234869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.235744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.236024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.236297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] PATH_INFO: `/v3/projects/f19db417c94f4f45a66ea65620f2a187/users/98ff75d757fa4b0fa4c2b90ec7c72c63/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.252636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19db417c94f4f45a66ea65620f2a187, user_id=98ff75d757fa4b0fa4c2b90ec7c72c63, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.253668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.253668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 12:56:16.253668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 12:56:16.255622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea512ce-4f98-43ad-b456-b27086991c10 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.270679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 754/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 12:56:16 2022] PUT /identity/v3/projects/f19db417c94f4f45a66ea65620f2a187/users/98ff75d757fa4b0fa4c2b90ec7c72c63/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:56:16.282504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583257-4c02-4b7d-87de-796b482f8e2f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.282794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583257-4c02-4b7d-87de-796b482f8e2f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.283073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583257-4c02-4b7d-87de-796b482f8e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.309438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-61583257-4c02-4b7d-87de-796b482f8e2f None None] MFA Rules not processed for user `98ff75d757fa4b0fa4c2b90ec7c72c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:56:16.310713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-61583257-4c02-4b7d-87de-796b482f8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:16.373314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 748/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:56:16.386685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470d35-7214-4277-aab8-e764fd33f108 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.386975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470d35-7214-4277-aab8-e764fd33f108 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.387250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a470d35-7214-4277-aab8-e764fd33f108 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.388648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 755/1503] 10.222.0.36 () {54 vars in 963 bytes} [Tue May 24 12:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:56:16.393697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd81a8-809a-42e0-a99e-6649fb698044 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.393934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd81a8-809a-42e0-a99e-6649fb698044 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.394254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd81a8-809a-42e0-a99e-6649fb698044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.412686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d2cd81a8-809a-42e0-a99e-6649fb698044 None None] MFA Rules not processed for user `68d8d9ddbe0c4ebb920c126f0122ce33`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:56:16.414573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d2cd81a8-809a-42e0-a99e-6649fb698044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:16.456318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:56:16.465477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 749/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Tue May 24 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:56:16.473195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a470d35-7214-4277-aab8-e764fd33f108 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.484462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a470d35-7214-4277-aab8-e764fd33f108 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.488029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.488690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.488969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.489242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.497892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.499387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.508275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 756/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:56:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:56:16.550790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309184f4-9d3d-4893-87d1-523f29854894 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.551082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309184f4-9d3d-4893-87d1-523f29854894 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.551356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309184f4-9d3d-4893-87d1-523f29854894 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.552662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 750/1506] 10.222.0.36 () {52 vars in 829 bytes} [Tue May 24 12:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:56:16.556287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.618089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06c9c3-2641-46f8-9908-2bd572706e5b service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.622915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.623784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.624068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.624343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] PATH_INFO: `/v3/users/98ff75d757fa4b0fa4c2b90ec7c72c63` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.625523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ff75d757fa4b0fa4c2b90ec7c72c63)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.626566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:16.626566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 12:56:16.626566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 12:56:16.627779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.696068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ff75d757fa4b0fa4c2b90ec7c72c63'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:16.716292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ff75d757fa4b0fa4c2b90ec7c72c63'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:16.725277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ff75d757fa4b0fa4c2b90ec7c72c63'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:16.734065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:56:16.738968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ff75d757fa4b0fa4c2b90ec7c72c63'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:16.739911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ff75d757fa4b0fa4c2b90ec7c72c63'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:16.747024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 757/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 12:56:16 2022] DELETE /identity/v3/users/98ff75d757fa4b0fa4c2b90ec7c72c63 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:56:16.751440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.751726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.752033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.770128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:56:16.771324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:16.827891 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 751/1508] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 12:56:16.837929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:16.839376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:16.896699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923aea2-ffb2-4422-9acc-d2b1a3ab69ab admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:16.901008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:16.901661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:16.901947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:16.902257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:16.911135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:16.912563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3be40-b028-4428-9d13-98f029fe7293 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:16.921960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 758/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:56:17.264314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:56:17.265870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:56:17.278724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53012b-525a-42cb-bfde-5eac7ca5f691 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:56:17.283446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:56:17.284321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:56:17.284633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:56:17.284910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] PATH_INFO: `/v3/projects/f19db417c94f4f45a66ea65620f2a187` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:56:17.286127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19db417c94f4f45a66ea65620f2a187)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:56:17.287168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 12:56:17.287168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 12:56:17.287168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 12:56:17.288364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:56:17.349220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19db417c94f4f45a66ea65620f2a187', 'request_id': 'req-a4f01fea-3401-44da-9644-023db5a082d3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:17.355538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19db417c94f4f45a66ea65620f2a187', 'request_id': 'req-a4f01fea-3401-44da-9644-023db5a082d3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:17.365310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19db417c94f4f45a66ea65620f2a187', 'request_id': 'req-a4f01fea-3401-44da-9644-023db5a082d3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:17.385389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] The token cache is being invalidate because project f19db417c94f4f45a66ea65620f2a187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 12:56:17.385681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:17.386384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a4f01fea-3401-44da-9644-023db5a082d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 12:56:17.388026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 752/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 12:56:17 2022] DELETE /identity/v3/projects/f19db417c94f4f45a66ea65620f2a187 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 12:56:26.917815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=29 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:56:27.381417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:01.458405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:01.458983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:01.458983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:01.460380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:01.465360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730771c7-bcd1-40eb-9b61-a1b19fceac39 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:01.465795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730771c7-bcd1-40eb-9b61-a1b19fceac39 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:01.465952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730771c7-bcd1-40eb-9b61-a1b19fceac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:01.484530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-730771c7-bcd1-40eb-9b61-a1b19fceac39 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:01.485447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-730771c7-bcd1-40eb-9b61-a1b19fceac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:01.545690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:01.716392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:01.718134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:01.792959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9e87f-b383-42aa-b876-39659ae464a3 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:01.798399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:01.799053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:01.799340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:01.799619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:01.808472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:01.810067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63546df9-91be-4856-a21e-38c0abd828e2 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:01.819776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 760/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:02.401360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398e1f-e36b-4a6e-97ae-739d33e7f9c1 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:02.401565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398e1f-e36b-4a6e-97ae-739d33e7f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:02.401844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398e1f-e36b-4a6e-97ae-739d33e7f9c1 None None] PATH_INFO: `/v3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:02.403235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 754/1514] 10.222.0.39 () {54 vars in 925 bytes} [Tue May 24 12:58:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 12:58:02.409940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df1bf1-56d5-4ae2-ac7e-4dd2c84f1d2a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:02.409940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df1bf1-56d5-4ae2-ac7e-4dd2c84f1d2a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:02.409940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df1bf1-56d5-4ae2-ac7e-4dd2c84f1d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:02.428697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-16df1bf1-56d5-4ae2-ac7e-4dd2c84f1d2a None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:02.429895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-16df1bf1-56d5-4ae2-ac7e-4dd2c84f1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:02.495246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 761/1515] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 24 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:02.703878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452a4b2-d94c-47bf-aa71-5aaf42859f84 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:02.704413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452a4b2-d94c-47bf-aa71-5aaf42859f84 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:02.704535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452a4b2-d94c-47bf-aa71-5aaf42859f84 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:02.705885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:02.711554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bea851-b75f-4a62-9136-6cc5018ac362 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:02.711851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bea851-b75f-4a62-9136-6cc5018ac362 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:02.712143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bea851-b75f-4a62-9136-6cc5018ac362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:02.730277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-53bea851-b75f-4a62-9136-6cc5018ac362 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:02.731520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-53bea851-b75f-4a62-9136-6cc5018ac362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:02.739885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:02.892004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452a4b2-d94c-47bf-aa71-5aaf42859f84 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:02.906326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452a4b2-d94c-47bf-aa71-5aaf42859f84 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:02.911780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:02.912420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:02.912707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:02.912989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:02.921063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:02.922709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458c995-5a6f-43ee-8566-4c5cd44048a4 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:02.932703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 756/1518] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:06.345009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748ac9-9818-4323-8630-310e74302bd0 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:06.345587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748ac9-9818-4323-8630-310e74302bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:06.345587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40748ac9-9818-4323-8630-310e74302bd0 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:06.347005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 763/1519] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 24 12:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:06.352779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c778a-6921-412f-b4c5-a751d3828bfc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:06.353206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c778a-6921-412f-b4c5-a751d3828bfc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:06.353371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c778a-6921-412f-b4c5-a751d3828bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:06.374933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-006c778a-6921-412f-b4c5-a751d3828bfc None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:06.376163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-006c778a-6921-412f-b4c5-a751d3828bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:06.385070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 757/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 24 12:58:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:06.392879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40748ac9-9818-4323-8630-310e74302bd0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:06.407299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40748ac9-9818-4323-8630-310e74302bd0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:06.413001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:06.413658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:06.413942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:06.414256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:06.423059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:06.424644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43cf31-e1d7-42a4-aa8b-b6f4183c469e service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:06.435015 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 764/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:14.226639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5399ed-7e69-4387-a43e-1f4b57b5a4d4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:14.227206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5399ed-7e69-4387-a43e-1f4b57b5a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:14.227206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5399ed-7e69-4387-a43e-1f4b57b5a4d4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:14.228616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:14.233391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef3f0-3be0-4895-8851-44aa68d28094 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:14.233821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef3f0-3be0-4895-8851-44aa68d28094 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:14.233953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef3f0-3be0-4895-8851-44aa68d28094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:14.252139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-85eef3f0-3be0-4895-8851-44aa68d28094 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:14.253341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85eef3f0-3be0-4895-8851-44aa68d28094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:14.261297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:14.415866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5399ed-7e69-4387-a43e-1f4b57b5a4d4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:14.430714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5399ed-7e69-4387-a43e-1f4b57b5a4d4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:14.436121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:14.436762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:14.437043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:14.437320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:14.445942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:14.447571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fae15a-d127-494d-82d1-4c2a44957403 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:14.456884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 759/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:15.317887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e9a2-fd4a-4ae8-821e-4314e2d5357c None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:15.318466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e9a2-fd4a-4ae8-821e-4314e2d5357c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:15.318466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623e9a2-fd4a-4ae8-821e-4314e2d5357c None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:15.319990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:15.324867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604802e4-3dc1-473e-a539-a4986ab7bef0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:15.325314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604802e4-3dc1-473e-a539-a4986ab7bef0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:15.325454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604802e4-3dc1-473e-a539-a4986ab7bef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:15.343285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-604802e4-3dc1-473e-a539-a4986ab7bef0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:15.344471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-604802e4-3dc1-473e-a539-a4986ab7bef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:15.352898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:15.503853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623e9a2-fd4a-4ae8-821e-4314e2d5357c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:15.518668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623e9a2-fd4a-4ae8-821e-4314e2d5357c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:15.525050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:15.525683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:15.525988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:15.526273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:15.534406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:15.535993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a4731-84df-4eb7-b528-e9b4f110c29d service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:15.546341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 767/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:19.593006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:19.593580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:19.593580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:19.595029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:19.600824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046a51-e4ca-4a4d-87b2-4804e5aa1259 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:19.601254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046a51-e4ca-4a4d-87b2-4804e5aa1259 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:19.601391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b046a51-e4ca-4a4d-87b2-4804e5aa1259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:19.620461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2b046a51-e4ca-4a4d-87b2-4804e5aa1259 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:19.621664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2b046a51-e4ca-4a4d-87b2-4804e5aa1259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:19.629550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:19.667079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:19.668679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:19.726029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbc08-d60f-4b85-aaec-e8a3b198a17f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:19.729574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:19.730240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:19.730527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:19.730799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:19.739595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:19.741996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8f49f-e009-4caa-95ee-dbf00c393b01 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:19.751421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 762/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:21.961710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06228bd-ce48-45b3-a51e-aa5ddcec0f77 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:21.962288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06228bd-ce48-45b3-a51e-aa5ddcec0f77 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:21.962288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06228bd-ce48-45b3-a51e-aa5ddcec0f77 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:21.963747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:21.968884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42af0-6d3a-4d6f-9764-58e35bd5111c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:21.969306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42af0-6d3a-4d6f-9764-58e35bd5111c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:21.969447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f42af0-6d3a-4d6f-9764-58e35bd5111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:21.987906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-15f42af0-6d3a-4d6f-9764-58e35bd5111c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:21.989097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-15f42af0-6d3a-4d6f-9764-58e35bd5111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:21.997850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:22.032578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06228bd-ce48-45b3-a51e-aa5ddcec0f77 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:22.043907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06228bd-ce48-45b3-a51e-aa5ddcec0f77 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:22.047396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:22.048033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:22.048318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:22.048594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:22.058315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:22.059742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c337b-b3c5-4bd1-9500-b870a37c5792 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:22.069432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 770/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:25.682181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:25.682726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:25.682726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:25.684076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:25.689562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762702-51a5-4131-b42d-6f7dfc6af701 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:25.689959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762702-51a5-4131-b42d-6f7dfc6af701 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:25.690213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762702-51a5-4131-b42d-6f7dfc6af701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:25.708318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8b762702-51a5-4131-b42d-6f7dfc6af701 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:25.709587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8b762702-51a5-4131-b42d-6f7dfc6af701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:25.717398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:25.988939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:25.990731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:26.047920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578dd9a-1df2-4508-8690-bcdfd44d4ee7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:26.051464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:26.052101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:26.052388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:26.052991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:26.061559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:26.063049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ffd86-140d-4b17-8ef3-a65d7eba904a service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:26.068224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:26.075138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 765/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:28.331138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:28.331668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:28.331792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:28.333112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 12:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 12:58:28.339347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48920c-d25a-4e3f-a507-e25c613d7605 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:28.339796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48920c-d25a-4e3f-a507-e25c613d7605 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:28.339926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48920c-d25a-4e3f-a507-e25c613d7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:28.358386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ea48920c-d25a-4e3f-a507-e25c613d7605 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 12:58:28.359586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ea48920c-d25a-4e3f-a507-e25c613d7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:28.367415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 12:58:28.640963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 12:58:28.642682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 12:58:28.651276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=94 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:28.657645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487a3f5-c42d-4f9b-9e3f-4c845eeeb6d2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 12:58:28.661249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 12:58:28.661879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 12:58:28.662286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 12:58:28.662476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 12:58:28.671768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 12:58:28.673201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17a4f-a0ba-4fef-8f62-f7ce416304cc service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 12:58:28.682935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 773/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 12:58:38.353088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 12:58:38.679074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:01.031869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.032546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.032546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.058578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.059827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.075703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 767/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.091529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.092129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.092129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.119273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.120523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.132530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 774/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.138349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.149855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff218-7593-4698-85dd-3cbc0bc4e8bd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.163212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.164304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.164816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.165341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.166348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.166902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.168876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638f154-40a7-460c-8acb-f06fa200b40c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.189313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 768/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.198379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.211291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87344-d282-40d8-95b0-c057dfed471d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.211997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87344-d282-40d8-95b0-c057dfed471d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.212500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87344-d282-40d8-95b0-c057dfed471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.214931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74c567-1b98-4a86-8320-f7aeba40481b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.231946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.232775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.233125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.233474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.234300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.236423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.263417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-69f87344-d282-40d8-95b0-c057dfed471d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.264786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-69f87344-d282-40d8-95b0-c057dfed471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.280603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 775/1543] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:01.285470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.444404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30849-e35d-40f0-a3a6-667a049d9bb1 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.450033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 769/1544] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 24 13:00:01.451651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f9045-9fc0-47ba-9b13-5b53bc75488d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.452083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f9045-9fc0-47ba-9b13-5b53bc75488d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.452815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f9045-9fc0-47ba-9b13-5b53bc75488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.464723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.465437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.465723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.466003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.466814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.468102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:01.468102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 13:00:01.468102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 13:00:01.469334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe15f-8a12-4e71-8f18-adb9df37ef78 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.494668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-231f9045-9fc0-47ba-9b13-5b53bc75488d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.496313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-231f9045-9fc0-47ba-9b13-5b53bc75488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.510090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 776/1545] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:01.511582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 770/1546] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.511740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87ffc-216d-4bbb-88cb-e4a1c1156b12 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.512975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e17b9-f436-4f4d-99f6-4a6d8c028ad3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.513310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e17b9-f436-4f4d-99f6-4a6d8c028ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.513588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e17b9-f436-4f4d-99f6-4a6d8c028ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.515449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87ffc-216d-4bbb-88cb-e4a1c1156b12 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.515945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87ffc-216d-4bbb-88cb-e4a1c1156b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.536582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-152e17b9-f436-4f4d-99f6-4a6d8c028ad3 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.537754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-152e17b9-f436-4f4d-99f6-4a6d8c028ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.537879 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e0a87ffc-216d-4bbb-88cb-e4a1c1156b12 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.539021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e0a87ffc-216d-4bbb-88cb-e4a1c1156b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.545632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 771/1547] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.549251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 777/1548] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.549393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.549393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.549393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.549663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46c9e-a4ba-4abb-9aea-2ea2c2f8e95d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.549663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46c9e-a4ba-4abb-9aea-2ea2c2f8e95d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.549663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46c9e-a4ba-4abb-9aea-2ea2c2f8e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.567735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.568578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-15c46c9e-a4ba-4abb-9aea-2ea2c2f8e95d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.568917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.569769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-15c46c9e-a4ba-4abb-9aea-2ea2c2f8e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.576978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 772/1549] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.577570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.578086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 778/1550] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.587849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b9ba-cff3-4ef5-b3a5-33f1f3de23b0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.588147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b9ba-cff3-4ef5-b3a5-33f1f3de23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.588250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18505f1b-aab7-4c61-9293-d54fc7ebf4aa None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.588431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b9ba-cff3-4ef5-b3a5-33f1f3de23b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.592938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.593603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.593890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.594205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.594964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.596603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f12274-6e0a-42ed-a123-0a9fb6eb8747 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.608058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 773/1551] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:01.609144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391034a7-ace9-4708-bab5-49857983328b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.609428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391034a7-ace9-4708-bab5-49857983328b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.609706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391034a7-ace9-4708-bab5-49857983328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.613936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-bec0b9ba-cff3-4ef5-b3a5-33f1f3de23b0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.615181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bec0b9ba-cff3-4ef5-b3a5-33f1f3de23b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.623390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 779/1552] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.624633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1534b3-a9bd-43dd-b9dc-f5e26237919f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.624926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1534b3-a9bd-43dd-b9dc-f5e26237919f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.625204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1534b3-a9bd-43dd-b9dc-f5e26237919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.631475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-391034a7-ace9-4708-bab5-49857983328b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.632689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-391034a7-ace9-4708-bab5-49857983328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.640744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 774/1553] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.641653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391034a7-ace9-4708-bab5-49857983328b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.643227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ba1534b3-a9bd-43dd-b9dc-f5e26237919f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.644568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ba1534b3-a9bd-43dd-b9dc-f5e26237919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.651411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391034a7-ace9-4708-bab5-49857983328b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.657463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 780/1554] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.657463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5df1-1e8b-4cb1-b100-9a25dd95d20f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.657463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5df1-1e8b-4cb1-b100-9a25dd95d20f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.657463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5df1-1e8b-4cb1-b100-9a25dd95d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.660560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.661423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.661715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.661998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.662802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.663114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.664734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9145cb-bd12-4048-9330-e629a728e292 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.675885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-945d5df1-1e8b-4cb1-b100-9a25dd95d20f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.677107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 775/1555] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.677258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-945d5df1-1e8b-4cb1-b100-9a25dd95d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.680464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.680989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.681503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.685715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 781/1556] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.687041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21b11-7413-42e4-8c4e-29aa86792735 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.687333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21b11-7413-42e4-8c4e-29aa86792735 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.687611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf21b11-7413-42e4-8c4e-29aa86792735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.701414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.702659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.706307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9bf21b11-7413-42e4-8c4e-29aa86792735 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.707540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9bf21b11-7413-42e4-8c4e-29aa86792735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.710992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 776/1557] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.712592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.715748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 782/1558] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.716965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.717255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.717534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.723721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb138e-b124-4f24-b418-18d98dde640f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.729272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.729933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.730260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.730541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.731271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.732918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb9e60-db83-4bb5-8184-3dc8a357eacc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.735681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.736865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.744597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 777/1559] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:01.749214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.749214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.749456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 783/1560] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.749544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.749620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.759035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e349de-05d1-4314-bdae-eb8f81947648 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.763576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.764304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.764587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.764860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.765579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.765884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.765979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:01.767045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:01.767045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 13:00:01.767045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 13:00:01.767311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:01.768148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.775456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 778/1561] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:01.776224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.780101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 784/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.780776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.789520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b39a7a-a41d-4e2d-83c7-a9b5bc8e4a9c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.791427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a07ba-e131-4bdb-a043-f694c904454f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.794051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.794728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.795053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.795335 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.796150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.796667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.797190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:01.797190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 13:00:01.797190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 13:00:01.797471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.797589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.797862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.798393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.798653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.798957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.800788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.813324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 785/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.814165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.827629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0492b59-15e3-40c9-8d4f-4887315b5a4e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.834412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.834607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 779/1564] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:01.835456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.835764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.836045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.836826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.837159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.838622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.839020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.851330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 786/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.852195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.861749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0158-40b2-41a5-910d-ece737298c8e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.890731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:01.895793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:01.908521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842fd85-ac2f-40ca-b82d-3671bad75ab4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.913330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.914035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.914356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.914638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.915375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.915686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.917330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.921547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.922488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.922775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.923051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] PATH_INFO: `/v3/projects/db7b0552512b4ddbb7a40ee485606d5c/users/80d7626dce354de8af8ce1894665c477/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.929994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 780/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.930910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.938597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7b0552512b4ddbb7a40ee485606d5c, user_id=80d7626dce354de8af8ce1894665c477, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.940991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b3ed-ac3f-4952-abe7-d71fee939384 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:01.941713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.945645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:01.946543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:01.946760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:01.947062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:01.947854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:01.948197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:01.949892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:01.955292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 787/1567] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:01 2022] PUT /identity/v3/projects/db7b0552512b4ddbb7a40ee485606d5c/users/80d7626dce354de8af8ce1894665c477/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:01.960350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.970519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 781/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:01.970519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:01.977196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25737e27-1fb0-4a14-b99b-96bd6e14cf9f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.023889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527173-dc95-4bef-862c-fec1790bcf89 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.028615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.029285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.029569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.029872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.030707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:02.031016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.032655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.033971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.035737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.035848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.036057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.036745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.038682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.044910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 788/1569] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:02.045638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.055588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ac7d-eb19-44aa-ad24-f04da291f27b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.060556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.061336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.061618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.061893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.062655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.064767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.070185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 782/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:01 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.071233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.098079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 789/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.099076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.137035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e2e25-e2d6-4883-8b1c-e505eab2ce4d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.163245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067709e-866e-458b-9ed3-523bff228442 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.167996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.168664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.168950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.169227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.169917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.171865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.189768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:02.197187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.198458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 790/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.199345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.199734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.200101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.200951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.202177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.203109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82be01-0f42-450f-bfae-4e9e88b1e751 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.222506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:02.225818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 783/1573] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.227152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.227447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.227732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.246940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:02.248220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:02.270141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c1d2-5ec5-4fe3-bd55-04e76e489412 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.276239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.277073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.277466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.277847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.278680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.280837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.311785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 791/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.311785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.315165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 784/1575] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:02.316295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.326719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81d429-50e4-4190-bc75-4919405dfa31 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.373863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76e56-2133-4f31-87a6-2a9eb0bc480c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.379452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.380286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.380573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.380919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.381658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.383610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.388938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.389714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.390151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.390545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.391329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.393340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.410047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 792/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.411429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.426298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 785/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.427144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.477947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898dd27-697c-4cd3-99fd-ba01971ac857 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.493664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e706da-4ec4-49bc-9432-a7ef9372ab5e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.498233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.498895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.499174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.499449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.500126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.502068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.508450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:02.525800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 786/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.526774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.532968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:02.537489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.538422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.538708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.539011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.539886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.540123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ebd3-9337-4d54-940c-6d514744cf6a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.541897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.545165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.545816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.546100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.546404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.547076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.548996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.562919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 793/1579] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.563671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.574747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 787/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.574747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.575024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628b698-48a7-4b42-a7a6-11dfbc6d6718 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.579968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.580711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.581056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.581337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.582284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.583895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e6b5-bceb-419c-b6e5-e9c2fc098373 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.584009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.588629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.589285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.589566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.589844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.590579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.592522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.594901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 794/1581] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.595736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.616650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 788/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.617646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.627533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46278-bbd5-463a-a503-257c4c32e047 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.633120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.633803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.634086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.634399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.635080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.637032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.656189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6aaf5-ee32-4cf5-bd1a-cce2b94706f6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.658494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 789/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.660565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.660712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.661217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.661500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.661781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.670798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ceceb-998a-4570-9e5d-03c2d633ad20 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.671133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.672666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.676588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.677409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.677703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.677984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.678718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.680666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.682758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 795/1584] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:02.683391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.692483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3254-15c5-4988-89c4-8e965a63f98b service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.697691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.698390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.698679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.698957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.699685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.701359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.706814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 790/1585] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:02 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:02.706814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.715558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6dfae-00c2-4844-aac7-5d8cdf306066 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.716910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 796/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.717690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.724910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.725761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.725923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.726163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.726990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.728595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.730320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433f58-76c8-425f-b298-0be48095cd61 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.735426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.736167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.736531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.736808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.737649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.739329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.741473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 791/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.742381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.751090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 797/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.751945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.752472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066774d-ed25-4a21-b460-218b6af76cb6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.758136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.758907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.759286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.759626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.760434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.762099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.763020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d2fc-a638-4c34-aad2-ff463af3c81f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.768099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.769764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.770248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.770698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.771597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.773377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.774799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 792/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.775792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.786754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627517b-4b7a-4588-b968-86239f79f6eb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.787370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 798/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.788236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.795034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.795709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.795987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.796262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.796996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.799336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.804213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e1bc6-356e-4867-bbb4-254768afe13b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.809756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.810919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 793/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.811114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.811554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.811907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.812147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.813101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.814910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.823755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e25a22-38fc-40b1-90fb-eabe638f1290 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.827437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 799/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.828426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.832096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.832751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.833017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.833276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.833967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.835597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.840376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc159f-2678-411b-a277-5efc3fa2375b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.846304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.847178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.847469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.847906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 794/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.848025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.848540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.850208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.851787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.861701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa030b-2686-41bf-bd25-35cf8b796895 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.867282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 800/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.867282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.871420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.872127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.872454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.872971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.873944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.875956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.879252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5adb-27b7-4c60-a153-6a004b420d8d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.884890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.885981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.886309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.886626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] PATH_INFO: `/v3/projects/71518b48d5f6444dbe7ecbe8b848d702/users/580e2c6b08e74296819889aa1d9935d4/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.892029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 795/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.892029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.901547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03fe63-5002-44c2-85c4-f99f414bbc6e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.906649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.907347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.907612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.907885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:02.908607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.911018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.916287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71518b48d5f6444dbe7ecbe8b848d702, user_id=580e2c6b08e74296819889aa1d9935d4, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:02.920331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:02.922023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 796/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:02.922928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.934702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365677f-faac-4c02-9c1f-bad8deab778b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:02.941276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 801/1597] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:02 2022] PUT /identity/v3/projects/71518b48d5f6444dbe7ecbe8b848d702/users/580e2c6b08e74296819889aa1d9935d4/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:02.942186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:02.994301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:02.998440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:02.999124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:02.999392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:02.999666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.000687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.002067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.013451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 797/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:03.014274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.025768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5fe8-6136-46ec-beac-67a2d61f7c60 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.028130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d226c-a5aa-4e3a-aeaa-6c8bc61484c3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.030951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.031933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.032328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.032669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] PATH_INFO: `/v3/projects/2595202cbb714ce8b697f77c99931b64/users/cc4f3a18a0e546f5964503078a11dfc5/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.032803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.033397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.033681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.033957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.035478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.037168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.048209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 802/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:03.048903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.052234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2595202cbb714ce8b697f77c99931b64, user_id=cc4f3a18a0e546f5964503078a11dfc5, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.053396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:03.053396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 13:00:03.053396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 13:00:03.055674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.060261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b3afd-8948-4619-966d-f54f3f520a92 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.064355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:03.067501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.068770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.069181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.069517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] PATH_INFO: `/v3/projects/f7ad79dd8bfc4ca98f933b2a628e2b0f/users/bf81345ea15d4c89b25354aa7221a39b/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.070649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 798/1600] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/2595202cbb714ce8b697f77c99931b64/users/cc4f3a18a0e546f5964503078a11dfc5/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.081959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.087422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ad79dd8bfc4ca98f933b2a628e2b0f, user_id=bf81345ea15d4c89b25354aa7221a39b, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.090257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.105729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 803/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/f7ad79dd8bfc4ca98f933b2a628e2b0f/users/bf81345ea15d4c89b25354aa7221a39b/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.106966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.156924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b195-e9fb-4875-9f57-1afb2873cfe9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.184719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229ae11-8d56-45c4-bf91-4916e283f192 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.189605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.191602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.191602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.191951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] PATH_INFO: `/v3/projects/a43d2ff60d9844a2855fd4dfb8456bea/users/651bbfad0aff4117bc3e85c67e0aae0e/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.208144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43d2ff60d9844a2855fd4dfb8456bea, user_id=651bbfad0aff4117bc3e85c67e0aae0e, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.211097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7144-87cb-47c4-88fc-f947ab1c37d2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.235597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.235731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 804/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/a43d2ff60d9844a2855fd4dfb8456bea/users/651bbfad0aff4117bc3e85c67e0aae0e/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.235825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.235825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.235825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] PATH_INFO: `/v3/projects/e8b40fb446274de791e05cd45262cde1/users/96d14f2ef79a4fac94127b2274ea88e3/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.236047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.236047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.236047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.248008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b40fb446274de791e05cd45262cde1, user_id=96d14f2ef79a4fac94127b2274ea88e3, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.250716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.266606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 799/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/e8b40fb446274de791e05cd45262cde1/users/96d14f2ef79a4fac94127b2274ea88e3/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.267784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.272998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] MFA Rules not processed for user `580e2c6b08e74296819889aa1d9935d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.274872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.343112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a23fe3-4099-4316-8149-8978a95892df admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.349772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.351553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.352033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.352493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] PATH_INFO: `/v3/projects/9960ef8191754c8db1e2ce3a880b1d3f/users/d852fe5617394882a0a11e903c1979f8/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.359745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 805/1604] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.362490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.375569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9960ef8191754c8db1e2ce3a880b1d3f, user_id=d852fe5617394882a0a11e903c1979f8, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.379409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e74d-595c-4908-a3bb-30a882d102f3 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.382003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7afc8-06a7-4499-9c63-162972886ed2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.386289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.387408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.387817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.388047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] PATH_INFO: `/v3/projects/07bc8db6fcd3437abcd8f7c6c01422c4/users/05e1bcfc943d49c588dc050de517a465/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.403614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 800/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/9960ef8191754c8db1e2ce3a880b1d3f/users/d852fe5617394882a0a11e903c1979f8/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.410540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bc8db6fcd3437abcd8f7c6c01422c4, user_id=05e1bcfc943d49c588dc050de517a465, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.413977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a69c5-a053-4a40-9211-62e7e48f352b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.415343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346251a-460c-41e7-915b-f310b769d11c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.415655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346251a-460c-41e7-915b-f310b769d11c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.415923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346251a-460c-41e7-915b-f310b769d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.417672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:03.436314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 806/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:03 2022] PUT /identity/v3/projects/07bc8db6fcd3437abcd8f7c6c01422c4/users/05e1bcfc943d49c588dc050de517a465/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:03.438141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab24ad9-c46b-4ca2-ba96-82ee93ae77ba None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.438532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab24ad9-c46b-4ca2-ba96-82ee93ae77ba None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.438915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab24ad9-c46b-4ca2-ba96-82ee93ae77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.445536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:03.455213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f346251a-460c-41e7-915b-f310b769d11c None None] MFA Rules not processed for user `cc4f3a18a0e546f5964503078a11dfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.458486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f346251a-460c-41e7-915b-f310b769d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.484470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-eab24ad9-c46b-4ca2-ba96-82ee93ae77ba None None] MFA Rules not processed for user `bf81345ea15d4c89b25354aa7221a39b`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.485951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-eab24ad9-c46b-4ca2-ba96-82ee93ae77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.566093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 801/1607] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.566776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541a6b-a529-45db-84d0-72b1414c54ed None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.567210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541a6b-a529-45db-84d0-72b1414c54ed None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.567597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf541a6b-a529-45db-84d0-72b1414c54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.573002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 807/1608] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.574141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.574461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.575413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.598704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.600312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.629071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bf541a6b-a529-45db-84d0-72b1414c54ed None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.632256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bf541a6b-a529-45db-84d0-72b1414c54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.707197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 808/1609] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.708283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.730808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 802/1610] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.730808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7249b-911e-4b2b-8c45-1ec488637207 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.741316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7249b-911e-4b2b-8c45-1ec488637207 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.742609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7249b-911e-4b2b-8c45-1ec488637207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.787977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5786d1-1c56-4c7a-a86b-7581978d3923 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:03.796472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-57d7249b-911e-4b2b-8c45-1ec488637207 None None] MFA Rules not processed for user `d852fe5617394882a0a11e903c1979f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.797834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-57d7249b-911e-4b2b-8c45-1ec488637207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.805530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:03.809798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.810093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.810403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.878729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:03.892682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 803/1611] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.894801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993c915-f830-4876-a65a-6fbdd4e3c8b5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.896598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993c915-f830-4876-a65a-6fbdd4e3c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.897451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993c915-f830-4876-a65a-6fbdd4e3c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.903706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:03.905832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127bfb9-dc57-4aa9-8af9-b6f5e7ebcefb service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:03.917295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 809/1612] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:03.919408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9993c915-f830-4876-a65a-6fbdd4e3c8b5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:03.920636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9993c915-f830-4876-a65a-6fbdd4e3c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:03.929996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 804/1613] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:03.931662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4042-bdcd-4ee2-9172-044325df0a10 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.932027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4042-bdcd-4ee2-9172-044325df0a10 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.932378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4042-bdcd-4ee2-9172-044325df0a10 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.934198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 805/1614] 10.222.0.36 () {54 vars in 961 bytes} [Tue May 24 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:03.935005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4042-bdcd-4ee2-9172-044325df0a10 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.944531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f38e1-8104-4a3d-a9f0-ebebbd813cef None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:03.945136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f38e1-8104-4a3d-a9f0-ebebbd813cef None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:03.946578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f38e1-8104-4a3d-a9f0-ebebbd813cef None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:03.950483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 810/1615] 10.222.0.36 () {54 vars in 961 bytes} [Tue May 24 13:00:03 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:03.952916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f38e1-8104-4a3d-a9f0-ebebbd813cef None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:03.977117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:04.025026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4042-bdcd-4ee2-9172-044325df0a10 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.029831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.030537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.030826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.031108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.043115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.045221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.056380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 806/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:04.057234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.067723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79597245-5448-4cbd-8abb-240f7f9f7f64 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.075120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.076215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.076693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.077206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.078412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.080524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb31add-1b63-4b3a-b3f1-1e88077bed9d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.118462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 807/1617] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:04 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:04.120050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.120350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.120725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.132144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f38e1-8104-4a3d-a9f0-ebebbd813cef None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.144067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:04.145757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:04.245984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 808/1618] 10.222.0.36 () {58 vars in 1058 bytes} [Tue May 24 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:04.248922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.311877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.312602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.312945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.313233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.408481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6771b-d6ff-4b82-b273-dfb581a7a698 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.420814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.421623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.421976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.422509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.486689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.489384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e695b-a6ff-4863-a6f1-e6951c6b2282 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.528421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 811/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:04.530160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.533666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.533964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.554520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:04.580317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:04.582214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:04.590976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.593035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.608429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 809/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:04.609968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.621647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 812/1621] 10.222.0.36 () {58 vars in 1058 bytes} [Tue May 24 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:04.622559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.626738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310924e9-3c42-4803-a174-1d6c4a450cd0 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.632203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.633267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.633750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.634185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.635435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.637725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.641754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26a0c4-17ec-42b2-be5e-66ac51941a03 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.657268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.658520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.658882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.659775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.674193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 810/1622] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:04 2022] POST /identity/v3/users => generated 308 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:04.677016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.701290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed3697-1b5c-4c43-999f-95aa35c9f1a1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.710882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.712114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.712825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.715850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.748960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:04.783964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.788542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.818732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 813/1623] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:04.818732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.857636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca47dfc-1e62-487b-aae5-95a1e417ea54 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.871712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.872396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.872682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.872959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.873699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.875617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.911932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 814/1624] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:04.916694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:04.953046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4d6f8-4a0a-434d-9c17-b9c3cdf17e6f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:04.962143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:04.964314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:04.978442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:04.978442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:04.978775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:04.978775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] PATH_INFO: `/v3/projects/0a3854e823be4957a8b2643a5977e7a2/users/ecf98a8275de4606a5ed4b09f283f45b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:04.993034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 811/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:05.012707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3854e823be4957a8b2643a5977e7a2, user_id=ecf98a8275de4606a5ed4b09f283f45b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.015708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.046623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 815/1626] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:04 2022] PUT /identity/v3/projects/0a3854e823be4957a8b2643a5977e7a2/users/ecf98a8275de4606a5ed4b09f283f45b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:05.051263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:05.067078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce912e4-58a3-4c59-ac94-1af710867a93 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:05.222290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:05.223049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.223378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.223663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.227555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.230910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498c1be-c84e-48a9-b1bd-0519d2e48604 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.281954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 812/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:05.291715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:05.321591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f4616-c6fc-4103-9c93-b8f889870b2d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:05.335627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:05.336646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.336980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.337261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] PATH_INFO: `/v3/projects/0a3854e823be4957a8b2643a5977e7a2/users/ecf98a8275de4606a5ed4b09f283f45b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.345308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3854e823be4957a8b2643a5977e7a2, user_id=ecf98a8275de4606a5ed4b09f283f45b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.348290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6743c-84f7-4ba9-ba5a-a2fded47d2d9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.400565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916851d-42cb-4c1c-af15-27575c545874 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.400959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916851d-42cb-4c1c-af15-27575c545874 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.401249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916851d-42cb-4c1c-af15-27575c545874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.402730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 816/1628] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:05 2022] PUT /identity/v3/projects/0a3854e823be4957a8b2643a5977e7a2/users/ecf98a8275de4606a5ed4b09f283f45b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:05.418426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b1de-bd90-4081-b579-636d283eb3f1 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.418775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b1de-bd90-4081-b579-636d283eb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.419044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b1de-bd90-4081-b579-636d283eb3f1 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.427266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 817/1629] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 24 13:00:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 13:00:05.429646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08056de1-a520-4b70-907e-d2cc56ec17f3 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.430132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08056de1-a520-4b70-907e-d2cc56ec17f3 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.430415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08056de1-a520-4b70-907e-d2cc56ec17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.465026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-08056de1-a520-4b70-907e-d2cc56ec17f3 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:05.467558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-08056de1-a520-4b70-907e-d2cc56ec17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:05.469328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9916851d-42cb-4c1c-af15-27575c545874 None None] MFA Rules not processed for user `ecf98a8275de4606a5ed4b09f283f45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:05.470936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9916851d-42cb-4c1c-af15-27575c545874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:05.583591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:05.619011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 813/1630] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:05.622146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43da8-fd91-444a-ab6a-5a419ad83e9b None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.622946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43da8-fd91-444a-ab6a-5a419ad83e9b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.623506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43da8-fd91-444a-ab6a-5a419ad83e9b None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.624729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 818/1631] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:05.625734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 814/1632] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 24 13:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:05.635403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.635697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.635978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.642506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43da8-fd91-444a-ab6a-5a419ad83e9b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:05.682429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:05.687155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:05.709471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 819/1633] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:05.710471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:05.764999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43da8-fd91-444a-ab6a-5a419ad83e9b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:05.773738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:05.774547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.775236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.775236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.807998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.811114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.840675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 815/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:05.848474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1f35e-c728-4c5e-88e4-994eb7fd3439 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:05.862078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:05.863597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.864061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.864410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.889880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.892783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.909612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:05.919462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2737f-a714-4aeb-9d7c-c3c7b242005d service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:05.932019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:05.934222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:05.936742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:05.939896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:05.947476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 820/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:05.965757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:05.967559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:05.981362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 816/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:06.174865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:06.220917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:06.342006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:06.399715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b714a-1997-4966-8315-b297378b2ece service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:06.414294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:06.417345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:06.417819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:06.418652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] PATH_INFO: `/v3/users/cc4f3a18a0e546f5964503078a11dfc5` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:06.421069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4f3a18a0e546f5964503078a11dfc5)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:06.425230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:06.492136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a46797-b13e-4885-967d-475e066c2883 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:06.498099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:06.499305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:06.499740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:06.502650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] PATH_INFO: `/v3/users/d852fe5617394882a0a11e903c1979f8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:06.518305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d852fe5617394882a0a11e903c1979f8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:06.542273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: WARNING py.warnings [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:06.542273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: warnings.warn(msg) May 24 13:00:06.542273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: May 24 13:00:06.548246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:06.551653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4f3a18a0e546f5964503078a11dfc5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.591658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4f3a18a0e546f5964503078a11dfc5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.610005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4f3a18a0e546f5964503078a11dfc5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.623210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4f3a18a0e546f5964503078a11dfc5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.625625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1b1d846a-3c47-40c1-810c-eea7ee6aa627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4f3a18a0e546f5964503078a11dfc5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.649730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 821/1637] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:06 2022] DELETE /identity/v3/users/cc4f3a18a0e546f5964503078a11dfc5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:06.653708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:06.654346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:06.654346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:06.707907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:06.709143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:06.749828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd852fe5617394882a0a11e903c1979f8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.750726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd852fe5617394882a0a11e903c1979f8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.752510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd852fe5617394882a0a11e903c1979f8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.826541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd852fe5617394882a0a11e903c1979f8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.889098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c7e67067-7f6e-45ac-a160-3c1d99626bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd852fe5617394882a0a11e903c1979f8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:06.915450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:06.942642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 817/1638] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:06 2022] DELETE /identity/v3/users/d852fe5617394882a0a11e903c1979f8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:06.947718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:06.948017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:06.948305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:06.957910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 822/1639] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:06.987218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:06.988776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:07.014263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:07.018750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:07.084386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:07.109084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98956fc7-3acd-4d63-a7bb-5e0e54cbdf83 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:07.247002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:07.248799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:07.249449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:07.249669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:07.282757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 818/1640] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:07.377229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:07.392287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb009e-cc33-48b4-b9ed-fb4de14aa2d4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:07.406135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:07.406837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:07.410511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:07.410823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:07.439348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:07.440907 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40134e-b68e-4832-8414-9d8ff1182e4a service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:07.473919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:07.475575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284783f5-066b-4f1a-9e58-766fb38ca70f service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:07.481751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 819/1641] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:07.501042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 823/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:08.778417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:08.778868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:08.778989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:08.870630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] MFA Rules not processed for user `651bbfad0aff4117bc3e85c67e0aae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:08.873064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.038026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 820/1643] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:09.049969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:09.050653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:09.050653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:09.086416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] MFA Rules not processed for user `651bbfad0aff4117bc3e85c67e0aae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:09.087692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.101266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 824/1644] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:09.112862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:09.114461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.159986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:09.161540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.191049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3253e-68c1-4d4d-b30e-5d4efb665281 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:09.206098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:09.209255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:09.209767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:09.210641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] PATH_INFO: `/v3/projects/9960ef8191754c8db1e2ce3a880b1d3f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:09.213843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9960ef8191754c8db1e2ce3a880b1d3f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:09.219284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: WARNING py.warnings [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 13:00:09.219284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: warnings.warn(msg) May 24 13:00:09.219284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: May 24 13:00:09.222718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:09.354325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52553f9-490f-4212-8550-48f70e6c5ac0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:09.382484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9960ef8191754c8db1e2ce3a880b1d3f', 'request_id': 'req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.389980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:09.421185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9960ef8191754c8db1e2ce3a880b1d3f', 'request_id': 'req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.440975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9960ef8191754c8db1e2ce3a880b1d3f', 'request_id': 'req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.476054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] The token cache is being invalidate because project 9960ef8191754c8db1e2ce3a880b1d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:09.476395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.479166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.494761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 825/1645] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:09 2022] DELETE /identity/v3/projects/9960ef8191754c8db1e2ce3a880b1d3f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:09.498184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:09.498184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.537351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:09.625872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe5e54-7e7f-4437-9be5-6af8b3cfd688 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:09.639517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:09.640422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:09.640699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:09.640977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] PATH_INFO: `/v3/projects/2595202cbb714ce8b697f77c99931b64` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:09.647385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2595202cbb714ce8b697f77c99931b64)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:09.649768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:09.758515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2595202cbb714ce8b697f77c99931b64', 'request_id': 'req-bb7b33da-32a0-4157-be64-3dd087a93fc9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.768483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2595202cbb714ce8b697f77c99931b64', 'request_id': 'req-bb7b33da-32a0-4157-be64-3dd087a93fc9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.786998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2595202cbb714ce8b697f77c99931b64', 'request_id': 'req-bb7b33da-32a0-4157-be64-3dd087a93fc9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.830376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] The token cache is being invalidate because project 2595202cbb714ce8b697f77c99931b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:09.831562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.836372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:09.843066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:09.843512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:09.851049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:09.851499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:09.856814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 826/1646] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:09 2022] DELETE /identity/v3/projects/2595202cbb714ce8b697f77c99931b64 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:09.862912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:09.864536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:09.873281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.016418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.019548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:10.026503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b33da-32a0-4157-be64-3dd087a93fc9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.039012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:10.039837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.040116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.040387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] PATH_INFO: `/v3/users/ecf98a8275de4606a5ed4b09f283f45b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.041113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 821/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:10.048783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:10.050151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf98a8275de4606a5ed4b09f283f45b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.052231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:10.067110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.101091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884df5-96e7-4a6a-a841-0f886d43fa12 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.110219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:10.117122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.117413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.117691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] PATH_INFO: `/v3/users/bf81345ea15d4c89b25354aa7221a39b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.119435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf81345ea15d4c89b25354aa7221a39b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.121581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:10.153281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf98a8275de4606a5ed4b09f283f45b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.163306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:10.180812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf98a8275de4606a5ed4b09f283f45b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.195730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf98a8275de4606a5ed4b09f283f45b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.217384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf98a8275de4606a5ed4b09f283f45b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.219927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-82a9a377-ae9d-4e56-bc65-dbf8f7b11580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf98a8275de4606a5ed4b09f283f45b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.231011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf81345ea15d4c89b25354aa7221a39b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.232092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf81345ea15d4c89b25354aa7221a39b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.232982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf81345ea15d4c89b25354aa7221a39b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.238960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 827/1648] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:09 2022] DELETE /identity/v3/users/ecf98a8275de4606a5ed4b09f283f45b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:10.240633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879889f-e5fe-4baa-8753-424e189e02ea None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.241187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879889f-e5fe-4baa-8753-424e189e02ea None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.241471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879889f-e5fe-4baa-8753-424e189e02ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.252127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf81345ea15d4c89b25354aa7221a39b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.267935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4957ad4a-28d7-42a0-98ad-e615bed31a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf81345ea15d4c89b25354aa7221a39b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:10.308746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 822/1649] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:10 2022] DELETE /identity/v3/users/bf81345ea15d4c89b25354aa7221a39b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:10.308918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-4879889f-e5fe-4baa-8753-424e189e02ea None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:10.310975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.311272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.311393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4879889f-e5fe-4baa-8753-424e189e02ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.311547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.338903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:10.340512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.366297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:10.468583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 828/1650] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:10.493670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.493988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.494327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.568786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:10.569793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.574269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 823/1651] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:10.581781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 829/1652] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:10.587039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:10.600495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521b232-eb37-496c-a1b1-f31ef5fba60f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.605611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:10.606274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.606563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.606840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.608176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:10.608577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.611143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:10.658253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 824/1653] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:10.660454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:10.674815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc78e10-2bdd-4232-9d15-8148c22c11fd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.685472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:10.686733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.687291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.688257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.689595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.696270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:10.739362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:10.741434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:10.791764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 830/1654] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:10 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:10.792991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:10.923811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee356d-5381-44e0-994b-57e34aa8bb6a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.963741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4e94e-32d8-4559-b30e-7c543e7f881c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:10.969844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:10.973463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:10.973463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:10.973463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:10.973463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:10.975075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.029454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.030232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.030775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.030877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.049283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.054814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 831/1655] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:10 2022] POST /identity/v3/users => generated 300 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:11.055884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.057210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.083479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 825/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:11.083639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786dcf6-3e54-4839-a4f5-a2072d2d2499 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.093959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.093959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.093959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.093959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.094350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.095515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.124308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 832/1657] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:11.131180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.141098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8290a-d867-49e4-8b02-c212d0f7d711 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.189671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.193023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.193317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.194265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.195119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.196769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409c3ba-b58b-4c85-a2b8-29a1c58dc781 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.230877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 826/1658] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:11.237724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.259669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40198a03-1d4b-4bba-a74b-83d211240a92 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.278718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.279700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.279966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.280269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] PATH_INFO: `/v3/projects/61273cfee96540f8ae869e08bf17fa70/users/a60d8b0a34824fcf9670078e3e9da768/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.320767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61273cfee96540f8ae869e08bf17fa70, user_id=a60d8b0a34824fcf9670078e3e9da768, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.330147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497e40-65d1-440b-8d03-16a4bc901f10 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.335851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:11.390251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 833/1659] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:11 2022] PUT /identity/v3/projects/61273cfee96540f8ae869e08bf17fa70/users/a60d8b0a34824fcf9670078e3e9da768/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:11.392829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.393210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.393670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.447151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] MFA Rules not processed for user `a60d8b0a34824fcf9670078e3e9da768`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:11.448404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:11.567087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:11.629893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 827/1660] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:11.634958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.635702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1b7d-75f5-480e-a4b1-03f64c133c1e None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.635702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1b7d-75f5-480e-a4b1-03f64c133c1e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.636710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1b7d-75f5-480e-a4b1-03f64c133c1e None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.639092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 834/1661] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 24 13:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:11.644995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.645554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.646176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.797666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167163-5a2a-4f63-b542-86f0d200b92a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.799164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:11.801110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:11.806032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.807085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.807398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.807771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.808482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.810603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:11.847518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 828/1662] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:11 2022] POST /identity/v3/projects => generated 399 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:11.859324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.939610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 835/1663] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:11.949048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:11.963250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a485fa6-0c48-410e-be84-0e17d6e505f1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.964250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df36d64-f137-4eba-b5f6-34360ed29cc0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:11.970665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:11.972462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:11.972926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:11.974189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:11.975079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:11.978082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.016669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 829/1664] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:11 2022] POST /identity/v3/users => generated 306 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:12.017886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.029643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b446-ca05-4454-959a-5150add66c49 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:12.038006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.038703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.039028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.039284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.040072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.042365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.064695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 830/1665] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:12.066493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.085604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b865ea-10f6-4985-a002-8e20cf9b51b0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:12.089541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.090389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.090582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.090868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.107330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.108140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.108427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.108707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] PATH_INFO: `/v3/projects/82ae52fbd3f94390bcc034584bc729a6/users/61673e99d96547b890f3778435940230/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.118771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.120636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.144192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 836/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:12.146967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ae52fbd3f94390bcc034584bc729a6, user_id=61673e99d96547b890f3778435940230, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.149955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.177645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 831/1667] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:12 2022] PUT /identity/v3/projects/82ae52fbd3f94390bcc034584bc729a6/users/61673e99d96547b890f3778435940230/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:12.181821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.202631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103859a-9956-4713-ab74-7f5ded3ea7f1 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:12.319244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.320031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.321163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.321506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.322542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.324594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790707d7-0fbf-4955-a30b-46b4dd0141e7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.339270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 837/1668] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:12.343472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.369755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba80f-f229-49ae-87fa-3d03ad501d50 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:12.387825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.388782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.389395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.389681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] PATH_INFO: `/v3/projects/82ae52fbd3f94390bcc034584bc729a6/users/61673e99d96547b890f3778435940230/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.392007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ae52fbd3f94390bcc034584bc729a6, user_id=61673e99d96547b890f3778435940230, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.394966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:12.445038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.445353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.445618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.453206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 832/1669] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:12 2022] PUT /identity/v3/projects/82ae52fbd3f94390bcc034584bc729a6/users/61673e99d96547b890f3778435940230/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:12.497580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] MFA Rules not processed for user `61673e99d96547b890f3778435940230`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:12.499111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:12.539143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:12.707989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 838/1670] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:12.716634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.720010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:12.750582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:12.872810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c785-d198-4ba3-840a-aad2b0887297 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:12.879334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:12.880143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:12.880660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:12.880831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:12.888740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:12.892258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:12.968869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:12.974701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:13.019226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 833/1671] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:13.180966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f6ba-243d-40ac-b3bc-15d23ee35881 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:13.199075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:13.200005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.200315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.200596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] PATH_INFO: `/v3/projects/0a3854e823be4957a8b2643a5977e7a2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.206168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3854e823be4957a8b2643a5977e7a2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:13.211441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:13.218623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:13.226062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e49d9-de2e-41b9-a8a8-9f187ee53c46 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:13.237664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:13.238531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.239091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.239408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.381267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3854e823be4957a8b2643a5977e7a2', 'request_id': 'req-d02ea4f2-781d-4294-885c-0eea41010ec0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.389020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3854e823be4957a8b2643a5977e7a2', 'request_id': 'req-d02ea4f2-781d-4294-885c-0eea41010ec0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.397887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:13.399599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaec52d-2103-462f-9fd4-2cf139395876 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:13.402361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3854e823be4957a8b2643a5977e7a2', 'request_id': 'req-d02ea4f2-781d-4294-885c-0eea41010ec0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.421629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] The token cache is being invalidate because project 0a3854e823be4957a8b2643a5977e7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:13.422279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.423410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.432330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 839/1672] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:12 2022] DELETE /identity/v3/projects/0a3854e823be4957a8b2643a5977e7a2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:13.433193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 834/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:13.434851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140ddf-0948-4005-bea9-3a4417b6fb67 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.435146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:13.435244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140ddf-0948-4005-bea9-3a4417b6fb67 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.435430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140ddf-0948-4005-bea9-3a4417b6fb67 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.436848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 835/1674] 10.222.0.36 () {54 vars in 960 bytes} [Tue May 24 13:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:13.440848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ec57-ba81-4928-8236-3514f6baef66 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.441140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ec57-ba81-4928-8236-3514f6baef66 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.441422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ec57-ba81-4928-8236-3514f6baef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.443721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:13.489738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9421ec57-ba81-4928-8236-3514f6baef66 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:13.489738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9421ec57-ba81-4928-8236-3514f6baef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:13.535304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:13.573017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea4f2-781d-4294-885c-0eea41010ec0 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:13.587560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:13.588455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.588739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.589011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] PATH_INFO: `/v3/projects/f7ad79dd8bfc4ca98f933b2a628e2b0f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.592139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ad79dd8bfc4ca98f933b2a628e2b0f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:13.597644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:13.683911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 836/1675] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:13.685461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b2e0-1009-41ec-8324-9c47a9f66ac4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.685801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b2e0-1009-41ec-8324-9c47a9f66ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.686102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b2e0-1009-41ec-8324-9c47a9f66ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.713854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3370b2e0-1009-41ec-8324-9c47a9f66ac4 None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:13.719904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3370b2e0-1009-41ec-8324-9c47a9f66ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:13.744170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ad79dd8bfc4ca98f933b2a628e2b0f', 'request_id': 'req-7d8412d9-a7bf-427d-9da8-33d206444a3e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.760883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ad79dd8bfc4ca98f933b2a628e2b0f', 'request_id': 'req-7d8412d9-a7bf-427d-9da8-33d206444a3e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.779379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ad79dd8bfc4ca98f933b2a628e2b0f', 'request_id': 'req-7d8412d9-a7bf-427d-9da8-33d206444a3e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.807200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] The token cache is being invalidate because project f7ad79dd8bfc4ca98f933b2a628e2b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:13.808580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.810270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7d8412d9-a7bf-427d-9da8-33d206444a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:13.814040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 840/1676] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:13 2022] DELETE /identity/v3/projects/f7ad79dd8bfc4ca98f933b2a628e2b0f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:13.818858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.822346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.822706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.846088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:13.881424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 837/1677] 10.222.0.36 () {58 vars in 1057 bytes} [Tue May 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:13.884403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51480-6046-4483-b170-080b4de16a3f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:13.884817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51480-6046-4483-b170-080b4de16a3f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:13.886912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51480-6046-4483-b170-080b4de16a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:13.922641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] MFA Rules not processed for user `80d7626dce354de8af8ce1894665c477`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:13.923902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:13.935460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-54d51480-6046-4483-b170-080b4de16a3f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:13.939481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-54d51480-6046-4483-b170-080b4de16a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.112791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 838/1678] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:14.115847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849c63-1dde-4694-b739-1572640b750d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.118201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849c63-1dde-4694-b739-1572640b750d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.118525 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849c63-1dde-4694-b739-1572640b750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.155387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 841/1679] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:14.156317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.168406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-64849c63-1dde-4694-b739-1572640b750d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:14.169687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-64849c63-1dde-4694-b739-1572640b750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.188228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661be7c4-aa04-4a08-ad79-703ec0a91916 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.201523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.203038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.203332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.204952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.213898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.214077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 839/1680] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:14.214077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849c63-1dde-4694-b739-1572640b750d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.239029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849c63-1dde-4694-b739-1572640b750d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.243214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.245148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f80ab-feb5-4ecc-a194-367db2a4fa17 service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.256913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.257657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.258187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.258997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.259310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:14.259654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.263702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75698-ec92-41bb-a8d2-17a24e9cfad6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.288074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 842/1681] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:14.291376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.291670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.295646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.310505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 840/1682] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:14.316107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.316439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.316731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.352584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] MFA Rules not processed for user `80d7626dce354de8af8ce1894665c477`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:14.353835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.355554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:14.356779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.379969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 843/1683] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:14.382182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.395610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 841/1684] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:14.395610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.398188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:14.429857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7fd0-8eef-463a-8acf-939518f223c7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.444522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.445213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.446128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.446128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.447956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.449968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.542823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 844/1685] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:14.551396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.598409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0fab-5e55-4ee9-a68c-a0622bc630b9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.620164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:14.717558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3cadb-8dd1-4242-84b0-653dd13431ad admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.726687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:14.731298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.732026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.732455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.733578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.734401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:14.734756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.739277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.751909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.754046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.754375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.754654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.804596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 845/1686] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:14.805569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.836980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b92a5-f047-4ef5-9604-83156a5f2b4b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.862244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.863425 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.863779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.864066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.865315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.867475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.911158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.915464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.937351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 846/1687] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:14.937509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 842/1688] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:14.952674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.952804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:14.966428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca36af-d889-4aab-a3ae-ee96b89f0961 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:14.980661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:14.981733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:14.982235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:14.982691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:14.983617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:14.988444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:14.988622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e26ef-9ad4-486b-bdb7-0684dfb09162 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.011555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 847/1689] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:15.012439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.024570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.026845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.027366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.028449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a5836-6050-4408-a05a-8f0af1efb4e6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.028817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.029737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.032543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.051938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.052795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.053096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.053382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.054227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.055847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.100118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 848/1690] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:15.100633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.117813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 843/1691] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:14 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:15.120202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994050-d95e-4070-8646-de66542101c4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.122606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.286834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.287808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.288097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.288380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] PATH_INFO: `/v3/projects/56751b58f32643429c02321c5273de73/users/c1aa3fa6def84303b9ccbae7e5489fa2/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.345258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56751b58f32643429c02321c5273de73, user_id=c1aa3fa6def84303b9ccbae7e5489fa2, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.353226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e65d8e-1286-4762-a71e-0fae6275060a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.396334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 849/1692] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:15 2022] PUT /identity/v3/projects/56751b58f32643429c02321c5273de73/users/c1aa3fa6def84303b9ccbae7e5489fa2/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:15.399040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.400511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.400813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.401830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821c1a-3fc8-4fef-bfe2-71a333796a21 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.447574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:15.450914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:15.510414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.511480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.512008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.512760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.513951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.517886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.577893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 844/1693] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:15 2022] POST /identity/v3/users => generated 286 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:15.582764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.621718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02179482-2e50-42f8-b73d-0b65aac3d9da admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.634185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.634898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.636009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 850/1694] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:15.636136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.636220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.638256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.655139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.657994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.660070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:15.666197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:15.704863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 845/1695] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:15.714328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.738137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:15.760931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9cd4-dd68-429a-9200-fda745743211 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.779901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.781139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.781447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.781735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.782508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.784271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.813995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9927dd-cdea-4b58-b844-aedb9892b633 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.828959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.829776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.830148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.830574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.853414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 846/1696] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:15.857729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:15.868504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.884188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e90a6-df5a-4105-bbeb-155feac15ef7 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:15.900209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645e16d-e138-4dff-bc36-c44a82953ef3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:15.917282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:15.922648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:15.922648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:15.922978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] PATH_INFO: `/v3/projects/80d0ca6c744f431d86f90669a18cbd27/users/e5ce9786a4714ab7897d689606ded97c/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:15.937047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 851/1697] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:15.991108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d0ca6c744f431d86f90669a18cbd27, user_id=e5ce9786a4714ab7897d689606ded97c, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:15.994229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:16.024393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 847/1698] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:15 2022] PUT /identity/v3/projects/80d0ca6c744f431d86f90669a18cbd27/users/e5ce9786a4714ab7897d689606ded97c/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:16.037637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200180-a27c-49ae-856e-9175cf76786b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:16.037912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200180-a27c-49ae-856e-9175cf76786b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:16.038543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200180-a27c-49ae-856e-9175cf76786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:16.115925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-29200180-a27c-49ae-856e-9175cf76786b None None] MFA Rules not processed for user `e5ce9786a4714ab7897d689606ded97c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:16.117365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-29200180-a27c-49ae-856e-9175cf76786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:16.375491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 852/1699] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:16.379970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:16.494530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200180-a27c-49ae-856e-9175cf76786b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:16.496162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-29200180-a27c-49ae-856e-9175cf76786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:16.579357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37fff2-c7b1-426b-8716-20e34cf6f88d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:16.592707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:16.593412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:16.593697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:16.593973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:16.594827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:16.606704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:16.677272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 848/1700] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:16 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:16.679594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:16.701385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200180-a27c-49ae-856e-9175cf76786b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:16.807882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87f59d-520e-4571-a59e-b66c4c222e11 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:16.808727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:16.825266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:16.826273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:16.826563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:16.826840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:16.832157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:16.834576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:16.856558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:16.857707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:16.858764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:16.859226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] PATH_INFO: `/v3/users/580e2c6b08e74296819889aa1d9935d4` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:16.863061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580e2c6b08e74296819889aa1d9935d4)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:16.865443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:16.881677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 849/1701] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:16 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:16.883036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:16.908529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfea9a-dc72-4bd8-8d8c-a5bee20765cc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:16.921557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:16.923782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:16.924083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:16.925609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:16.927867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:16.930916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:16.971292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 850/1702] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:16.973520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:16.982018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580e2c6b08e74296819889aa1d9935d4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:17.002797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06eca4-90ed-4c7f-9437-18de8c1d52cc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:17.019292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:17.019739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580e2c6b08e74296819889aa1d9935d4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:17.021821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.022138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.022440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] PATH_INFO: `/v3/projects/0589659eade244ebae50fcd846aa03d3/users/50cb61dc9ec24370bf5b10d20462e48c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.040981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580e2c6b08e74296819889aa1d9935d4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:17.057816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580e2c6b08e74296819889aa1d9935d4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:17.058720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-95e8aeaa-4ff3-429b-9c1f-88ff1bc5bbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580e2c6b08e74296819889aa1d9935d4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:17.066402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0589659eade244ebae50fcd846aa03d3, user_id=50cb61dc9ec24370bf5b10d20462e48c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:17.069093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:17.074479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 853/1703] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:16 2022] DELETE /identity/v3/users/580e2c6b08e74296819889aa1d9935d4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:17.079107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae661-9552-48da-ba9c-87a443dcfd65 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.079409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae661-9552-48da-ba9c-87a443dcfd65 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.079765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ae661-9552-48da-ba9c-87a443dcfd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.102254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 851/1704] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:16 2022] PUT /identity/v3/projects/0589659eade244ebae50fcd846aa03d3/users/50cb61dc9ec24370bf5b10d20462e48c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:17.103880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:17.106338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:17.118072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b35ae661-9552-48da-ba9c-87a443dcfd65 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:17.120785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b35ae661-9552-48da-ba9c-87a443dcfd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:17.127957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:17.335853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 854/1705] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:17.337818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.338169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.345375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.384214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323d377-2b58-4365-8d0e-0c658b6c2d67 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:17.396591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:17.397327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.397636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.398034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.400021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:17.404661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:17.468465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] MFA Rules not processed for user `96d14f2ef79a4fac94127b2274ea88e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:17.477509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:17.478208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 852/1706] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:17.479214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:17.488005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:17.692272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e4ed9-219f-4723-9a6d-7a8a6e26c478 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:17.706273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:17.707230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.707690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.707977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.730513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:17.748524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:17.750008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bc4e8-f3aa-47b0-a4cd-66fc597f2d8d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:17.775941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 855/1707] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:17.780440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:17.803188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 853/1708] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:17.814920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf02b-ce2e-455b-8257-8b07490c588c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:17.822842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ace0-42a6-4330-97ce-3ddc11c7c0be None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.823225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ace0-42a6-4330-97ce-3ddc11c7c0be None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.823708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6ace0-42a6-4330-97ce-3ddc11c7c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.831749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:17.833888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:17.835163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:17.837724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] PATH_INFO: `/v3/projects/0589659eade244ebae50fcd846aa03d3/users/50cb61dc9ec24370bf5b10d20462e48c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:17.842227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0589659eade244ebae50fcd846aa03d3, user_id=50cb61dc9ec24370bf5b10d20462e48c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:17.860546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:17.862514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9ca6ace0-42a6-4330-97ce-3ddc11c7c0be None None] MFA Rules not processed for user `80d7626dce354de8af8ce1894665c477`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:17.866549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9ca6ace0-42a6-4330-97ce-3ddc11c7c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:17.901518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 856/1709] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:17 2022] PUT /identity/v3/projects/0589659eade244ebae50fcd846aa03d3/users/50cb61dc9ec24370bf5b10d20462e48c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:17.903492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:17.912502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:18.081043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 854/1710] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:18.081043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:18.081043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:18.085297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:18.190541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] MFA Rules not processed for user `50cb61dc9ec24370bf5b10d20462e48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:18.201500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:18.294390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379013f-7a96-4852-91df-3efaf42a37b4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:18.317087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:18.321933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:18.323012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:18.324366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:18.402791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:18.532262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:18.534409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715d375-0131-4ec5-a139-89cbe93d7929 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:18.540652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 855/1711] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:18.551912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 857/1712] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:18.563967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:18.566029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:18.711070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:18.712134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:18.717626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:18.720608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368ef4-591e-426f-b92a-c19a37bcb004 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:18.730738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:18.732603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:18.733015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:18.735090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:18.765530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:18.769302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:18.777954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:18.779610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:18.797153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 856/1713] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:18.919249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 858/1714] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:19.195298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:19.197312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:19.446750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac543fc-6319-49f1-a318-43c7ef10ede8 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:19.468785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:19.469465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:19.469755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:19.470031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:19.518381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:19.525721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:19.553845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 857/1715] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:00:19.799029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:19.800708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:19.841853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:19.907073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:19.999553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41daf1-f1b0-4ae8-acad-06db6c6c208f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:20.023969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:20.025252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.025761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.026273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] PATH_INFO: `/v3/projects/71518b48d5f6444dbe7ecbe8b848d702` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.033382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=71518b48d5f6444dbe7ecbe8b848d702)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:20.040090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:20.060480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3488f-4ede-4181-a8f8-1f59423ecd43 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:20.076286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:20.077369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.077652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.077929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] PATH_INFO: `/v3/users/e5ce9786a4714ab7897d689606ded97c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.079973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ce9786a4714ab7897d689606ded97c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:20.085623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:20.119928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:20.186910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71518b48d5f6444dbe7ecbe8b848d702', 'request_id': 'req-61acf7e3-b9bb-4384-a698-8bb97a5703ab'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.217709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71518b48d5f6444dbe7ecbe8b848d702', 'request_id': 'req-61acf7e3-b9bb-4384-a698-8bb97a5703ab'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.228859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ce9786a4714ab7897d689606ded97c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.230662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ce9786a4714ab7897d689606ded97c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.232223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ce9786a4714ab7897d689606ded97c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.239422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71518b48d5f6444dbe7ecbe8b848d702', 'request_id': 'req-61acf7e3-b9bb-4384-a698-8bb97a5703ab'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.265806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ce9786a4714ab7897d689606ded97c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.272419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] The token cache is being invalidate because project 71518b48d5f6444dbe7ecbe8b848d702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:20.273711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.277057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.280348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-51fa0144-d038-4109-a267-f74dd723f48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ce9786a4714ab7897d689606ded97c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.283836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 859/1716] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:19 2022] DELETE /identity/v3/projects/71518b48d5f6444dbe7ecbe8b848d702 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:20.284847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:20.287832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:20.306291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 858/1717] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:19 2022] DELETE /identity/v3/users/e5ce9786a4714ab7897d689606ded97c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:20.308005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3af61-8fba-41b2-82eb-dcff42cbb32e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.308746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3af61-8fba-41b2-82eb-dcff42cbb32e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.308746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3af61-8fba-41b2-82eb-dcff42cbb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.347366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-04a3af61-8fba-41b2-82eb-dcff42cbb32e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:20.348866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-04a3af61-8fba-41b2-82eb-dcff42cbb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:20.498986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acf7e3-b9bb-4384-a698-8bb97a5703ab admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:20.585288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 859/1718] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:20.588306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c56c-57c5-48ec-9552-d2d39aaad1a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.590538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c56c-57c5-48ec-9552-d2d39aaad1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.590996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c56c-57c5-48ec-9552-d2d39aaad1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.637596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:20.652870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-53e9c56c-57c5-48ec-9552-d2d39aaad1a1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:20.656858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-53e9c56c-57c5-48ec-9552-d2d39aaad1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:20.665127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:20.668195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.670023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.670399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] PATH_INFO: `/v3/users/a60d8b0a34824fcf9670078e3e9da768` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.674774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60d8b0a34824fcf9670078e3e9da768)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:20.676792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:20.681430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 860/1719] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:20.686039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49092-83bc-4df2-8d7a-43991872d15e None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.687298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49092-83bc-4df2-8d7a-43991872d15e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.688727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49092-83bc-4df2-8d7a-43991872d15e None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.702863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 861/1720] 10.222.0.36 () {54 vars in 912 bytes} [Tue May 24 13:00:20 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:20.706709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d00f8-0dab-45d7-b7a4-5327d5be1e24 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.707029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d00f8-0dab-45d7-b7a4-5327d5be1e24 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.707342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d00f8-0dab-45d7-b7a4-5327d5be1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.763915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-136d00f8-0dab-45d7-b7a4-5327d5be1e24 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:20.767184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-136d00f8-0dab-45d7-b7a4-5327d5be1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:20.800445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 862/1721] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:20.804743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6e7b-7b56-4c5b-b440-1c0715f2a8b7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:20.805049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6e7b-7b56-4c5b-b440-1c0715f2a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:20.805322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6e7b-7b56-4c5b-b440-1c0715f2a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:20.832959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60d8b0a34824fcf9670078e3e9da768'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.862853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-cfcd6e7b-7b56-4c5b-b440-1c0715f2a8b7 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:20.867986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cfcd6e7b-7b56-4c5b-b440-1c0715f2a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:20.879228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60d8b0a34824fcf9670078e3e9da768'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.902483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60d8b0a34824fcf9670078e3e9da768'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.916426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60d8b0a34824fcf9670078e3e9da768'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.917217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60d8b0a34824fcf9670078e3e9da768'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:20.936486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 860/1722] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:20 2022] DELETE /identity/v3/users/a60d8b0a34824fcf9670078e3e9da768 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:20.936486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:20.947741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.071610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 863/1723] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:21.073140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.073434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.073715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.129990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:21.130725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2dd3d-f6a9-4f28-99dc-fed745dc36e6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.134759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.156490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.159458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.163069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.163387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.166732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:21.168179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.170931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 864/1724] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:21.172444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.180190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.216396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.267191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:21.308953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 861/1725] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:21.312516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.325151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.372435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2dc6c-cd19-403f-ac77-139750eae1d6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.397367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.397367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.397658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.397936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.419035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.449240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.450578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.489614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf6c12-28b3-4641-b2a1-dd06a0d3aa3e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.495968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 865/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:21.497971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.500212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.501256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.501795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.502461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.519334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.521448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.524282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3d92-7d67-4450-b806-c28997f32d82 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.539649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 862/1727] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:21.540505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.541173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.541459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.541737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.544239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.562837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.564336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a941-c545-4e02-bac4-efba03ba363c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.576906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694034af-251c-4e30-ac64-ce68e67b1879 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.587139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.588773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.589276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.589760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.590527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 866/1728] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:21.591379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.591906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.592216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.592507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.594710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.630930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:21.638854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:21.647519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:21.676805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 863/1729] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:21 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:21.682894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.695398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 867/1730] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:21.730630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.747746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441ebdb-95b3-41ed-8af5-bece3cebee68 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.817447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a0122-aaf6-42c8-8bfc-c7abd4852e0d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.828073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.828789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.829085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.829364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.834587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.836653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.882260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.883232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 864/1731] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:21 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:21.884647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.885162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.888094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.888887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.910354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.913792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.916010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6cc38-4cd9-4614-bd63-2cd17132880c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.926641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.927419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.927652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.928386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.928873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.931999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.937263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 868/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:21.946999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 865/1733] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:21.951162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:21.967096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bef8-2820-47ac-88c0-9dd60dfd45ee service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:21.974190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:21.975277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:21.975809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:21.976343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:21.977369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:21.979331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb867f-064e-44cf-84f6-84631e95ac1e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:21.993309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 869/1734] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:21.997906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:22.014405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122043f-9bbe-4171-be11-18713fa591f6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:22.020238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:22.021565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:22.022329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:22.022850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] PATH_INFO: `/v3/projects/a74f3f21e50d4e63a5c6f19ff339f157/users/c625ede17459473f9751d745cd9484dd/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:22.050935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f3f21e50d4e63a5c6f19ff339f157, user_id=c625ede17459473f9751d745cd9484dd, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:22.053955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:22.120261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 866/1735] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:21 2022] PUT /identity/v3/projects/a74f3f21e50d4e63a5c6f19ff339f157/users/c625ede17459473f9751d745cd9484dd/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:22.125819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4d31-cedb-4445-a648-f516b409131b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:22.126471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4d31-cedb-4445-a648-f516b409131b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:22.127751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4d31-cedb-4445-a648-f516b409131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:22.198940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-002a4d31-cedb-4445-a648-f516b409131b None None] MFA Rules not processed for user `c625ede17459473f9751d745cd9484dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:22.202025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-002a4d31-cedb-4445-a648-f516b409131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:22.419606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 870/1736] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:22.425410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:22.652723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e253e9-a62c-45a8-84c3-98072e116d99 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:22.676550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:22.677317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:22.677635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:22.678671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:22.679268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:22.686823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:22.753509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 867/1737] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:22 2022] POST /identity/v3/projects => generated 379 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:22.757832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4d31-cedb-4445-a648-f516b409131b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:22.773516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4d31-cedb-4445-a648-f516b409131b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:22.843994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:22.936895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:22.937537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:22.937824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:22.938104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:22.938839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:22.943535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:23.005392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 871/1738] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:22 2022] POST /identity/v3/users => generated 296 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:23.009621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:23.029487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d517-964a-47a9-a09d-625158cfef06 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:23.039465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:23.040482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.041271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.042449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.043448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:23.045464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:23.077344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 868/1739] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:23.082001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:23.098915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33556d39-7dc5-42c9-8df4-0fe366ba5764 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:23.116120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:23.117407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.117896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.118391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] PATH_INFO: `/v3/projects/6928c7a2234c45dbb42542924dd0375b/users/cbd401f1a44b4643bf703512e4f25775/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.176304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928c7a2234c45dbb42542924dd0375b, user_id=cbd401f1a44b4643bf703512e4f25775, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:23.179504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:23.220403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 872/1740] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:23 2022] PUT /identity/v3/projects/6928c7a2234c45dbb42542924dd0375b/users/cbd401f1a44b4643bf703512e4f25775/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:23.222391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:23.245074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c58b-fe59-4ade-818f-c287c64ecd00 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:23.303438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:23.474931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:23.475664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.475977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.476230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.477222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:23.481990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c090e-cf2f-4a42-9d63-babc9261839c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:23.513631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 869/1741] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:23.514704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:23.535119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ccd2b-58a9-4df8-8e1f-ef67b89b567b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:23.555627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:23.561522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.561825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.562128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] PATH_INFO: `/v3/projects/6928c7a2234c45dbb42542924dd0375b/users/cbd401f1a44b4643bf703512e4f25775/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.569317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928c7a2234c45dbb42542924dd0375b, user_id=cbd401f1a44b4643bf703512e4f25775, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:23.579071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40fcaf-2b7f-41cb-9086-4e1d1e630c44 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:23.623659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 873/1742] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:23 2022] PUT /identity/v3/projects/6928c7a2234c45dbb42542924dd0375b/users/cbd401f1a44b4643bf703512e4f25775/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:23.626917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b0f8-e479-48a6-84ee-9314f0d504e6 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.628674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b0f8-e479-48a6-84ee-9314f0d504e6 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.629120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b0f8-e479-48a6-84ee-9314f0d504e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.727200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6d16b0f8-e479-48a6-84ee-9314f0d504e6 None None] MFA Rules not processed for user `cbd401f1a44b4643bf703512e4f25775`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:23.729297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6d16b0f8-e479-48a6-84ee-9314f0d504e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:23.849563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.850278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.850689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:23.853652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 874/1743] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:23.934284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 870/1744] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:23.948613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:23.950526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:23.973138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450d3-1184-461b-8017-5ca91144e45f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:23.973668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450d3-1184-461b-8017-5ca91144e45f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:23.974378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450d3-1184-461b-8017-5ca91144e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:24.069830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fb2450d3-1184-461b-8017-5ca91144e45f None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:24.079152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fb2450d3-1184-461b-8017-5ca91144e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:24.225244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313bb7a-4842-4fb9-9b99-85d663b4c949 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:24.232581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:24.233268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:24.233840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:24.234138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:24.271154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:24.275800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:24.298449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 871/1745] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:24.329263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 875/1746] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:25.199307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:25.199893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:25.200547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:25.293119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] MFA Rules not processed for user `c1aa3fa6def84303b9ccbae7e5489fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:25.295434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:25.345119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:25.380733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8f9d-916b-4203-933d-89d62e161fa0 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:25.390823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:25.413147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd401f1a44b4643bf703512e4f25775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6928c7a2234c45dbb42542924dd0375b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:25.420386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:25.423677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:25.427566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:25.432235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:25.432542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:25.441934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:25.518217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 876/1747] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:25.520544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:25.532240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:25.624529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe93d-760d-4838-90e5-ef5097923c89 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:25.650739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 872/1748] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:25.651658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:25.653119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:25.653795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:25.654075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:25.654374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:25.703166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:25.704910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:25.709975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396dcc4-74fb-4573-a38d-6e7144a106a7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:25.729675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd401f1a44b4643bf703512e4f25775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6928c7a2234c45dbb42542924dd0375b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:25.734040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:25.734040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:25.740095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:25.743233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:25.752520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:25.766186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 877/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:25.768884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:25.777324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:25.850021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 873/1750] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:25 2022] POST /identity/v3/projects => generated 355 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:25.858262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:26.029033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:26.085243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a80d35-1aa3-4891-9ed9-6ed79cdaa4cd service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:26.137006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ccc1b-f17d-43ea-9468-1dd9c0d3ca65 tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:26.168245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd401f1a44b4643bf703512e4f25775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6928c7a2234c45dbb42542924dd0375b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:26.175320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:26.175509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:26.175802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:26.181636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:26.182147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:26.183820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:26.291835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 874/1751] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:26.300595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:26.301584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:26.301982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:26.302471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:26.303454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:26.305552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:26.456243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 878/1752] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:25 2022] POST /identity/v3/projects => generated 405 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:26.460808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:26.462021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:26.496822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601099-f2a6-431d-9d43-f3e407a8fb4c tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:26.748384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:26.755668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:26.756717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:26.757244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:26.758358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:26.761621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:26.803349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e3815-79cb-48d5-8ebe-511006d82d4d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:26.822601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 875/1753] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:26 2022] POST /identity/v3/users => generated 309 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:26.824485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd401f1a44b4643bf703512e4f25775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6928c7a2234c45dbb42542924dd0375b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:26.825166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:26.825419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:26.827219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:26.827571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] PATH_INFO: `/v3/projects/06410fc385fe43858685696623b1af53` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:26.828823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:26.833107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06410fc385fe43858685696623b1af53)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:26.845239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:26.852400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d47132-7514-466a-b16d-a30cf35a44ed admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:26.858778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:26.859917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:26.860558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:26.860908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] PATH_INFO: `/v3/projects/80d0ca6c744f431d86f90669a18cbd27` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:26.863027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d0ca6c744f431d86f90669a18cbd27)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:26.865837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:26.951031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:26.983523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06410fc385fe43858685696623b1af53', 'request_id': 'req-1968cb20-2f00-4448-ab73-05f323d5377a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:26.995858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06410fc385fe43858685696623b1af53', 'request_id': 'req-1968cb20-2f00-4448-ab73-05f323d5377a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.014060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06410fc385fe43858685696623b1af53', 'request_id': 'req-1968cb20-2f00-4448-ab73-05f323d5377a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.021076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d0ca6c744f431d86f90669a18cbd27', 'request_id': 'req-f0617f62-895f-49d5-8aa2-acf0cd82b389'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.056412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d0ca6c744f431d86f90669a18cbd27', 'request_id': 'req-f0617f62-895f-49d5-8aa2-acf0cd82b389'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.059291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] The token cache is being invalidate because project 06410fc385fe43858685696623b1af53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:27.059806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.062534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.075202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d0ca6c744f431d86f90669a18cbd27', 'request_id': 'req-f0617f62-895f-49d5-8aa2-acf0cd82b389'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.079688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 879/1754] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:26 2022] DELETE /identity/v3/projects/06410fc385fe43858685696623b1af53 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:27.083198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:27.085478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:27.100039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] The token cache is being invalidate because project 80d0ca6c744f431d86f90669a18cbd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:27.102101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.112359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.123621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 876/1755] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:26 2022] DELETE /identity/v3/projects/80d0ca6c744f431d86f90669a18cbd27 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:27.125900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:27.131010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:27.173381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:27.348208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617f62-895f-49d5-8aa2-acf0cd82b389 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:27.360876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:27.362330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:27.364947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:27.365667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:27.368430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:27.372554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:27.394589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968cb20-2f00-4448-ab73-05f323d5377a tempest-VolumeQuotaClassesTest-414508286 tempest-VolumeQuotaClassesTest-414508286-project-admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:27.420498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:27.423342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:27.426023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:27.427758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] PATH_INFO: `/v3/projects/61273cfee96540f8ae869e08bf17fa70` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:27.433167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 877/1756] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:27.433336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61273cfee96540f8ae869e08bf17fa70)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:27.436667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:27.439977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:27.441364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:27.507173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f015ce-27a0-4131-a36f-73404ae05aff admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:27.532802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:27.536204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:27.536532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:27.536868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] PATH_INFO: `/v3/users/50cb61dc9ec24370bf5b10d20462e48c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:27.546658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cb61dc9ec24370bf5b10d20462e48c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:27.549153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:27.643240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61273cfee96540f8ae869e08bf17fa70', 'request_id': 'req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.664364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61273cfee96540f8ae869e08bf17fa70', 'request_id': 'req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.686735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61273cfee96540f8ae869e08bf17fa70', 'request_id': 'req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.733334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] The token cache is being invalidate because project 61273cfee96540f8ae869e08bf17fa70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:27.733681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.734897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.739132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cb61dc9ec24370bf5b10d20462e48c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.740011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 880/1757] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:27 2022] DELETE /identity/v3/projects/61273cfee96540f8ae869e08bf17fa70 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:27.746946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:27.751527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:27.786819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cb61dc9ec24370bf5b10d20462e48c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.811155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cb61dc9ec24370bf5b10d20462e48c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.834124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cb61dc9ec24370bf5b10d20462e48c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.840293 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cb61dc9ec24370bf5b10d20462e48c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:27.866390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 878/1758] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:27 2022] DELETE /identity/v3/users/50cb61dc9ec24370bf5b10d20462e48c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:27.866390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:27.868598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:27.932992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:27.943010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83b0e-ed0b-45e2-91b0-db9bd8a1f630 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:28.113435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:28.136557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:28.137507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.137856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.138210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] PATH_INFO: `/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a/users/bec3bb27eb104ecfa4fa04e41eafc8fc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.153811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc3512-b69a-4fca-b05a-1cc5f1e5fdd1 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:28.180628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:28.181672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.181960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.185675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] PATH_INFO: `/v3/users/61673e99d96547b890f3778435940230` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.189090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5796b8daa8d42f2b681adf4e2218b5a, user_id=bec3bb27eb104ecfa4fa04e41eafc8fc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:28.190487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61673e99d96547b890f3778435940230)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:28.200883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:28.203640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:28.238368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 881/1759] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:27 2022] PUT /identity/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a/users/bec3bb27eb104ecfa4fa04e41eafc8fc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:28.244046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:28.249979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:28.391868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61673e99d96547b890f3778435940230'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.427136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61673e99d96547b890f3778435940230'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.447289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61673e99d96547b890f3778435940230'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.463965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61673e99d96547b890f3778435940230'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.465608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61673e99d96547b890f3778435940230'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.484377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 879/1760] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:27 2022] DELETE /identity/v3/users/61673e99d96547b890f3778435940230 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:28.485063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:28.494244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:28.515326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90cd3-b4cd-484c-9573-f0effff7ba2a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:28.643914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f7314-424c-4a0d-933a-e633851ba0c1 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:28.667394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:28.668279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.668482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.668805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.669547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:28.671521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:28.699926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 880/1761] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:28.700847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:28.724600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6bd6-fdc8-43cb-8f83-9a58d12e55bb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:28.728062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:28.728944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.729220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.729501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] PATH_INFO: `/v3/users/c625ede17459473f9751d745cd9484dd` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.731222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c625ede17459473f9751d745cd9484dd)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:28.733372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:28.741187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:28.742270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.742729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.742976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] PATH_INFO: `/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a/users/bec3bb27eb104ecfa4fa04e41eafc8fc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.745990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5796b8daa8d42f2b681adf4e2218b5a, user_id=bec3bb27eb104ecfa4fa04e41eafc8fc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:28.748542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df082554-0a67-4152-9b4c-55620e72e4ec admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:28.781064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 881/1762] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:28 2022] PUT /identity/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a/users/bec3bb27eb104ecfa4fa04e41eafc8fc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:28.788889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.789185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.789499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.872367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c625ede17459473f9751d745cd9484dd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.873058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c625ede17459473f9751d745cd9484dd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.875192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c625ede17459473f9751d745cd9484dd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.875888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] MFA Rules not processed for user `05e1bcfc943d49c588dc050de517a465`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:28.878803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:28.889503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:28.916960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c625ede17459473f9751d745cd9484dd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.940204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cb8661f7-400e-4719-9379-0d783a61f26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c625ede17459473f9751d745cd9484dd'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:28.972572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 882/1763] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:28 2022] DELETE /identity/v3/users/c625ede17459473f9751d745cd9484dd => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:28.976739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:28.977010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:28.977289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:28.992512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:29.014898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:29.016144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:29.218029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 883/1764] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:29.218601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 882/1765] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:29.234806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:29.237443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:29.431337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e806e5-be63-4ca1-8d1e-75f0e685138a None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:29.447258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:29.448025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:29.448316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:29.448599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:29.524989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:29.526975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:29.558542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 884/1766] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:29.597278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:29.600060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:29.737618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb56c0-d6b8-4f4e-8103-7474d02f744d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:30.028205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:30.029085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:30.029445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:30.029811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:30.071320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:30.072996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3198-1638-415b-884d-431d4af0a3bc service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:30.126398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 883/1767] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:30.816419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:30.818374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:30.845930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394b6e-ebb4-4e65-a97d-82c6f98dc3ff service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:30.859773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:30.860689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:30.860963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:30.861811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] PATH_INFO: `/v3/projects/0589659eade244ebae50fcd846aa03d3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:30.867028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0589659eade244ebae50fcd846aa03d3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:30.873653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:30.968733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:30.996239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0589659eade244ebae50fcd846aa03d3', 'request_id': 'req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.014027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0589659eade244ebae50fcd846aa03d3', 'request_id': 'req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.041032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0589659eade244ebae50fcd846aa03d3', 'request_id': 'req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.077594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] The token cache is being invalidate because project 0589659eade244ebae50fcd846aa03d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:31.077903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.080302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-59cd5c35-d287-4975-8d7f-29ab8ba0cbf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.087496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 885/1768] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:30 2022] DELETE /identity/v3/projects/0589659eade244ebae50fcd846aa03d3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:31.093708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.094317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.094803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.136106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:31.139615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:31.322766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 884/1769] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:31.331707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.332468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.332960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.389164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:31.396676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:31.421865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 886/1770] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:31.423229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:31.424829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:31.428365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:31.452908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8af59-a9fa-48ef-9890-518946513061 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:31.460895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668b620-f46e-4f05-80f4-78a8067e44f8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:31.467595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:31.469063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.469561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.470456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] PATH_INFO: `/v3/projects/82ae52fbd3f94390bcc034584bc729a6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.474081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ae52fbd3f94390bcc034584bc729a6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:31.475103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:31.475995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.476392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.476796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.477094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:31.478952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:31.486770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:31.488245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:31.501950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:31.537275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 887/1771] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:31.538646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:31.560799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3a2a-4f5f-4917-81bf-f320f6cd6597 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:31.572088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:31.572931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.573477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.573918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.574872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:31.577077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:31.646298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ae52fbd3f94390bcc034584bc729a6', 'request_id': 'req-6c110266-8ca5-4a00-83c4-c2d18d550319'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.665666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ae52fbd3f94390bcc034584bc729a6', 'request_id': 'req-6c110266-8ca5-4a00-83c4-c2d18d550319'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.680164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 888/1772] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:31 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:31.686213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ae52fbd3f94390bcc034584bc729a6', 'request_id': 'req-6c110266-8ca5-4a00-83c4-c2d18d550319'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.688182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:31.737598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] The token cache is being invalidate because project 82ae52fbd3f94390bcc034584bc729a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:31.737598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.738539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6c110266-8ca5-4a00-83c4-c2d18d550319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:31.740789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 885/1773] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:31 2022] DELETE /identity/v3/projects/82ae52fbd3f94390bcc034584bc729a6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:31.758527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c89d-f568-4d0d-9fdf-cc7bef9d1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.758819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c89d-f568-4d0d-9fdf-cc7bef9d1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.759104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56c89d-f568-4d0d-9fdf-cc7bef9d1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.813126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3e56c89d-f568-4d0d-9fdf-cc7bef9d1fb2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:31.815168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3e56c89d-f568-4d0d-9fdf-cc7bef9d1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:31.869293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ed4c-410e-445c-98a4-dc70ebe47b05 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:31.886972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:31.888049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.888495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.888965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.889894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:31.892119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:31.935193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 889/1774] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:31 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:31.938147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:31.942329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:31.970962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111314-6916-4ab1-903e-cc58e0741c67 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:31.986894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:31.987727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:31.988018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:31.988318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:31.989120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:31.991109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.020521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 890/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:32.021847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.042652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb670fc-46da-44dd-bf9d-906ae037c822 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:32.064705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 886/1776] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:32.071748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0798-3507-4f7e-8dda-85b778d13f39 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.071926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:32.072035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0798-3507-4f7e-8dda-85b778d13f39 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.072299 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0798-3507-4f7e-8dda-85b778d13f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.072550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.072846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.073130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.073872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:32.075634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.104557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 891/1777] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:32.106008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.125390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa74d-72fb-4a3e-9fbb-4a713894a0eb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:32.139281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5d3e0798-3507-4f7e-8dda-85b778d13f39 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:32.141452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:32.141567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5d3e0798-3507-4f7e-8dda-85b778d13f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:32.141695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.141695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.141695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] PATH_INFO: `/v3/projects/cc14d3b57ee14add85ed5c4b27dd29b9/users/930b2153d0354bfca8b3c6ffa0353ad1/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.171007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 887/1778] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:32.173304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.173872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.174439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.191876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc14d3b57ee14add85ed5c4b27dd29b9, user_id=930b2153d0354bfca8b3c6ffa0353ad1, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:32.194854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.227203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 892/1779] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:32 2022] PUT /identity/v3/projects/cc14d3b57ee14add85ed5c4b27dd29b9/users/930b2153d0354bfca8b3c6ffa0353ad1/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:32.227203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.284611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] MFA Rules not processed for user `96d14f2ef79a4fac94127b2274ea88e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:32.287983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:32.318247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:32.401899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c7ec0-b907-46ae-9623-d8130774b417 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:32.412628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:32.413317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.413584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.413860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.414784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:32.415093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:32.416824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa9e8b-53c9-4219-a5cb-e41fa97aafde admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.452354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 893/1780] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:32.454043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.454328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.455427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.461716 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 888/1781] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:32.475449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.524285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90982d-7f47-418b-aa31-922a0b467fd0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:32.529461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] MFA Rules not processed for user `930b2153d0354bfca8b3c6ffa0353ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:32.530512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:32.543609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:32.544439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.544725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.547267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.547791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:32.550084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.668230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 889/1782] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:32.668230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.691588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:32.695431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 894/1783] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:32.707215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:32.751202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38975024-cda2-4ad8-800a-7f48215d851c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:32.890540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:32.891973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:32.891973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:32.891973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:32.892993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:32.895121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:32.943528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 895/1784] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:32.947921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.037817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:33.118687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66794-da20-46bd-88cc-92753584f757 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.135559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.136492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.138075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.138425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.140796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.145809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.151688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0b23-e373-48f5-8c02-73da34cf157a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.170014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.170880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.171172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.171506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.172415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.174693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.199188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 896/1785] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:33.200583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.233665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 890/1786] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:32 2022] POST /identity/v3/users => generated 282 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:33.233913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a00a-22a3-4911-b96c-c3273a0c96ef admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.238679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.251235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.255299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.255615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.255905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.258879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.259855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9bba-b1a4-4583-a9c9-7969cbf15c3a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.260559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.279774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.280532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.280900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.281252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.282137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.285368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.312208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 891/1787] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:33.316912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.323158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 897/1788] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:33.324636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.334679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f42d-6a16-4bf8-aa10-d1b9d1a5a7a5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.364073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.364809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.365407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.366137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.366455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.368166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.368378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e354f-76b5-4919-b73f-b5eda1eaaf6d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.383620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.387463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.388313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.389045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] PATH_INFO: `/v3/projects/bc4663086c734b35b368318524e239c1/users/16e726872ed14e52bc6d917042210976/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.395482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 892/1789] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:33.399786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.423897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb673-6517-41e2-87fe-21ca6206a11d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.432121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.433145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.433450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.433758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] PATH_INFO: `/v3/projects/988ff9776ea7481a9ed94b8697602481/users/11aaa09ce8f4407990df3168e8bb19ad/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.436240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4663086c734b35b368318524e239c1, user_id=16e726872ed14e52bc6d917042210976, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.440219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.468958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 898/1790] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:33 2022] PUT /identity/v3/projects/bc4663086c734b35b368318524e239c1/users/16e726872ed14e52bc6d917042210976/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:33.470518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] RBAC: Authorizing `identity:create_grant(project_id=988ff9776ea7481a9ed94b8697602481, user_id=11aaa09ce8f4407990df3168e8bb19ad, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.473641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.473832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f1314-e48c-4cbb-9d92-0114b93d019d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.505095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 893/1791] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:33 2022] PUT /identity/v3/projects/988ff9776ea7481a9ed94b8697602481/users/11aaa09ce8f4407990df3168e8bb19ad/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:33.517047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a229cd-cae1-40df-ae83-6983bf82ee3e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.518411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a229cd-cae1-40df-ae83-6983bf82ee3e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.519107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a229cd-cae1-40df-ae83-6983bf82ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.591103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-11a229cd-cae1-40df-ae83-6983bf82ee3e None None] MFA Rules not processed for user `11aaa09ce8f4407990df3168e8bb19ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:33.592880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-11a229cd-cae1-40df-ae83-6983bf82ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:33.645515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073bcf-6585-48c0-89cd-0e92b7de178b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.770062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 894/1792] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:33.771485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.771774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.772067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.785396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.786219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.786495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.786927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.787736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.790924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.822083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 899/1793] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:33.823133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.839749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] MFA Rules not processed for user `bec3bb27eb104ecfa4fa04e41eafc8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:33.841407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:33.855986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fea2d8-4e60-4cee-a404-20cc3e84c53f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:33.866259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:33.866951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:33.867234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:33.868145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:33.868259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:33.870156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:33.929682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:33.960545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 900/1794] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:33 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:33.962661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:33.965230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:33.988108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:34.030667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 895/1795] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:34.031651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.043052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a518c8-3bfd-483a-9274-95daa7128ae0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.090644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2123b-8442-4b36-bcbf-399dcffff953 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.106625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.107556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.107657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.107833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.108075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] PATH_INFO: `/v3/projects/a74f3f21e50d4e63a5c6f19ff339f157` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.108969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.108969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.109203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] PATH_INFO: `/v3/projects/bc4663086c734b35b368318524e239c1/users/16e726872ed14e52bc6d917042210976/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.109288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74f3f21e50d4e63a5c6f19ff339f157)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.111862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4663086c734b35b368318524e239c1, user_id=16e726872ed14e52bc6d917042210976, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.112107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.114808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.126902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 896/1796] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:34 2022] PUT /identity/v3/projects/bc4663086c734b35b368318524e239c1/users/16e726872ed14e52bc6d917042210976/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:34.127798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.185879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74f3f21e50d4e63a5c6f19ff339f157', 'request_id': 'req-a003080b-66d1-4a1e-b5ee-a86a42f442e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.193967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74f3f21e50d4e63a5c6f19ff339f157', 'request_id': 'req-a003080b-66d1-4a1e-b5ee-a86a42f442e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.205182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74f3f21e50d4e63a5c6f19ff339f157', 'request_id': 'req-a003080b-66d1-4a1e-b5ee-a86a42f442e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.221047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] The token cache is being invalidate because project a74f3f21e50d4e63a5c6f19ff339f157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:34.221315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.222366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a003080b-66d1-4a1e-b5ee-a86a42f442e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.224274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 901/1797] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:33 2022] DELETE /identity/v3/projects/a74f3f21e50d4e63a5c6f19ff339f157 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:34.225677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.226687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.227005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.266461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] MFA Rules not processed for user `16e726872ed14e52bc6d917042210976`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:34.281822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:34.285232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281da1c1-1fb0-4111-8773-053889928385 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.425159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.425873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.426180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.426499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.427276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.429445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.434765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 902/1798] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:34.435704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.437125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:34.452741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa579b-66d7-48eb-bbf6-0ddf025fe55c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.464364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:34.465703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.467553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.468244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.468244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] PATH_INFO: `/v3/users/cbd401f1a44b4643bf703512e4f25775` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.469798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd401f1a44b4643bf703512e4f25775)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.472917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.492992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 897/1799] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:34 2022] POST /identity/v3/users => generated 290 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:34.494090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.497084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:34.502938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:34.541073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd401f1a44b4643bf703512e4f25775'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.543947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd401f1a44b4643bf703512e4f25775'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.545879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd401f1a44b4643bf703512e4f25775'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.570383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd401f1a44b4643bf703512e4f25775'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.579269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd401f1a44b4643bf703512e4f25775'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:34.604608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 903/1800] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:34 2022] DELETE /identity/v3/users/cbd401f1a44b4643bf703512e4f25775 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:34.605773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.607899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:34.656530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa90b6-966f-49ce-8b1c-106f278aa8c6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.767542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c321-eaa6-4756-a028-74519c2319ce admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.786074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.787866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.789454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.789588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.792325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.795642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.801315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.802026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.802325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.802629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.810878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:34.823492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 904/1801] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:34.824351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.849263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205d22-a8e2-4ffd-9caf-dd3cbda79346 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:34.856376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:34.857385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:34.857693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:34.859884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] PATH_INFO: `/v3/projects/5b91acfa2a9e4fd097f223bdeca87173/users/c174c9d69ad24d9b814c1915137df6f1/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:34.916382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91acfa2a9e4fd097f223bdeca87173, user_id=c174c9d69ad24d9b814c1915137df6f1, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.919157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:34.950462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 905/1802] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:34 2022] PUT /identity/v3/projects/5b91acfa2a9e4fd097f223bdeca87173/users/c174c9d69ad24d9b814c1915137df6f1/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:34.960519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:34.983886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:34.985409 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:35.024508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 898/1803] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:35.059448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:35.061068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:35.085863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc505e-6acd-4658-a2ab-55b30fb282cc service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:35.117482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22c0d-401d-4faa-8568-e02a1aec8396 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:35.123259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:35.123917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.124325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.124614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.125362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:35.128828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:35.140792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 906/1804] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:35.144923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:35.152241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:35.158784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e846-2dba-4ee0-9ade-6ccaf6c96fe3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:35.172030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:35.179731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.185718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.186140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] PATH_INFO: `/v3/projects/5b91acfa2a9e4fd097f223bdeca87173/users/c174c9d69ad24d9b814c1915137df6f1/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.192771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91acfa2a9e4fd097f223bdeca87173, user_id=c174c9d69ad24d9b814c1915137df6f1, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:35.200607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60264-4b72-416e-a69a-fc415ab92db6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:35.233450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 907/1805] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:35 2022] PUT /identity/v3/projects/5b91acfa2a9e4fd097f223bdeca87173/users/c174c9d69ad24d9b814c1915137df6f1/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:35.243736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.244240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.244656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.245484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:35.249533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.251514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.253426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] PATH_INFO: `/v3/users/930b2153d0354bfca8b3c6ffa0353ad1` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.255631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] RBAC: Authorizing `identity:delete_user(user_id=930b2153d0354bfca8b3c6ffa0353ad1)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:35.265073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:35.268865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:35.288571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] MFA Rules not processed for user `c174c9d69ad24d9b814c1915137df6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:35.290565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:35.361703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930b2153d0354bfca8b3c6ffa0353ad1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:35.384206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930b2153d0354bfca8b3c6ffa0353ad1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:35.397677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930b2153d0354bfca8b3c6ffa0353ad1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:35.414101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930b2153d0354bfca8b3c6ffa0353ad1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:35.415041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-12d85c6c-4acd-4f86-b1e5-6d2d973a454b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930b2153d0354bfca8b3c6ffa0353ad1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:35.429812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 899/1806] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:35 2022] DELETE /identity/v3/users/930b2153d0354bfca8b3c6ffa0353ad1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:35.432749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87aaf4-3b4d-43ab-818f-16e6b106a16c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.433218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87aaf4-3b4d-43ab-818f-16e6b106a16c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.434203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87aaf4-3b4d-43ab-818f-16e6b106a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.494212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-0a87aaf4-3b4d-43ab-818f-16e6b106a16c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:35.507037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0a87aaf4-3b4d-43ab-818f-16e6b106a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:35.521417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 908/1807] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:35.547730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:35.551508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:35.629688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 900/1808] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:35.631605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.636019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.639887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.639887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 901/1809] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:00:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:35.683562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c74ea8-cdbd-43a7-b1f8-76a1f2a8d589 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:35.751510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:35.753377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:35.816547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:35.818040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.818897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.819379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.918726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610013a-f3fa-4f42-9172-1d1098719197 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:35.922893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:35.925260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:35.925260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:35.925260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:35.955486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:35.958129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.003259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 902/1810] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:36.004744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.007007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.015102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:36.040941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198d829-baf8-4a7f-b10a-8db452b28e89 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.051840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:36.054298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.055544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.055779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.056146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] PATH_INFO: `/v3/projects/6928c7a2234c45dbb42542924dd0375b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.057605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff149-3eee-4af1-ab9f-14a7cde6a924 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.061030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6928c7a2234c45dbb42542924dd0375b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.063482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.094770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 909/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:36.117364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761214f-4acc-4403-9925-ed127b8fe7ab None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.118234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761214f-4acc-4403-9925-ed127b8fe7ab None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.119157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761214f-4acc-4403-9925-ed127b8fe7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.124606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:36.192898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6928c7a2234c45dbb42542924dd0375b', 'request_id': 'req-115ee2a5-9d2b-44a8-a099-b3c892931666'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:36.209851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c761214f-4acc-4403-9925-ed127b8fe7ab None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:36.212432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c761214f-4acc-4403-9925-ed127b8fe7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.231978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6928c7a2234c45dbb42542924dd0375b', 'request_id': 'req-115ee2a5-9d2b-44a8-a099-b3c892931666'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:36.262605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6928c7a2234c45dbb42542924dd0375b', 'request_id': 'req-115ee2a5-9d2b-44a8-a099-b3c892931666'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:36.277591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] The token cache is being invalidate because project 6928c7a2234c45dbb42542924dd0375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:36.278480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:36.279394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-115ee2a5-9d2b-44a8-a099-b3c892931666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:36.282148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 903/1812] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:36 2022] DELETE /identity/v3/projects/6928c7a2234c45dbb42542924dd0375b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:36.288459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.289020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.289533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.324403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:36.326506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.420543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 904/1813] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:36.421664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.424441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.439341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 910/1814] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:36.444595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c960e-22c3-498f-8a25-3f4b5f97bc65 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.445674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c960e-22c3-498f-8a25-3f4b5f97bc65 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.446501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c960e-22c3-498f-8a25-3f4b5f97bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.498741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-566c960e-22c3-498f-8a25-3f4b5f97bc65 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:36.504125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-566c960e-22c3-498f-8a25-3f4b5f97bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.531230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 911/1815] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:36.531230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269cac2-b7bd-4c1b-a6a6-ba5c3495b4a4 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.531230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269cac2-b7bd-4c1b-a6a6-ba5c3495b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.531230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269cac2-b7bd-4c1b-a6a6-ba5c3495b4a4 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.533333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 912/1816] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:36.537135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269cac2-b7bd-4c1b-a6a6-ba5c3495b4a4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.570077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e15e0-43ad-4894-b545-ad4bb0cc8e4b None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.572238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269cac2-b7bd-4c1b-a6a6-ba5c3495b4a4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.580687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:36.582844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:36.583875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.584667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.585463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.585852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.586544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.587375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.588229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:36.589767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.590351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.592070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55375e5d-6b3b-42f9-a29c-f1d4dca11c0d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.626882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 913/1817] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:36.626882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.626882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.628729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.667642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:36.668886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.760943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.763061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.770873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 914/1818] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:36.771740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.775520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 905/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:36.776541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.778839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.792828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:36.804573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67f44-6ce1-4e90-9656-918a9c9b5da5 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.806284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaae90-3a86-41bf-9a22-e6eece70dd67 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.822965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:36.823939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.824187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.824549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.831665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:36.835582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:36.836280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:36.837014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:36.838085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.838287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:36.840094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.841491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:36.870524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 906/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:36.872747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.878542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:36.882994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 915/1821] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:36.889289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:36.919590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac880-1390-4852-a970-17e9c256f66e service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:36.951424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:37.036664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940757b2-3428-45ec-80c5-f5a77f67b19f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.052132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.053509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.053509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.053509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.054434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.056682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.096854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 916/1822] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:36 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:37.097914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:37.100760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.101426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.101854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.102220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.115207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.117849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.122347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79e03-3756-41e0-85c4-45e7ac93cfc4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.135397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.136977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.139185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.139535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.142520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.148986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.155619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 907/1823] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:37.178171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 917/1824] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:37.182893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:37.197661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c591c-dac2-450d-a20f-14ac86ad4807 service placement] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.207144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.211083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.211373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.211661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.214918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.217189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa51f2-76d6-4569-8e29-e08b7688d3d5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.249587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:37.253586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 908/1825] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:37.276418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035410ba-3af3-4c1b-9c02-83c4b8d6064e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.290282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.293165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.293912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.294233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] PATH_INFO: `/v3/projects/3692370204014c03a4276073b7448aab/users/55aa6024206845df9142448ba5316e5f/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.336764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3692370204014c03a4276073b7448aab, user_id=55aa6024206845df9142448ba5316e5f, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.340071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.374297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 918/1826] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:37 2022] PUT /identity/v3/projects/3692370204014c03a4276073b7448aab/users/55aa6024206845df9142448ba5316e5f/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:37.384276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.384599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.384839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.457119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] MFA Rules not processed for user `55aa6024206845df9142448ba5316e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:37.459332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:37.573468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 909/1827] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:37.583327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:37.674763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:37.676924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:37.762584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32269a2c-a7e5-410c-9b54-042c4168a3a1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.775509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.776305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.776589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.776865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.788209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:37.795386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.796793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f949-bf8e-4a7e-a183-fe4d58e5a883 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:37.797159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09fc7d-1a4c-4771-8a02-1d375c550915 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.804631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:37.805847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.806170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.807091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] PATH_INFO: `/v3/projects/cc14d3b57ee14add85ed5c4b27dd29b9` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.808604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc14d3b57ee14add85ed5c4b27dd29b9)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:37.811690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:37.831217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 919/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:37.865874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:37.866312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:37.867011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:37.893578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] MFA Rules not processed for user `05e1bcfc943d49c588dc050de517a465`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:37.895466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:38.024296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc14d3b57ee14add85ed5c4b27dd29b9', 'request_id': 'req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.040970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 920/1829] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:38.043460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:38.071318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc14d3b57ee14add85ed5c4b27dd29b9', 'request_id': 'req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.083176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478ae93-d11f-419c-89a1-6d9888daf4e4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:38.089492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc14d3b57ee14add85ed5c4b27dd29b9', 'request_id': 'req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.108421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] The token cache is being invalidate because project cc14d3b57ee14add85ed5c4b27dd29b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:38.108715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.109404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.114166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 910/1830] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:37 2022] DELETE /identity/v3/projects/cc14d3b57ee14add85ed5c4b27dd29b9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:38.124063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:38.129454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:38.144526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:38.203888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:38.204293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:38.205107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:38.206172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] PATH_INFO: `/v3/users/55aa6024206845df9142448ba5316e5f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:38.208486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55aa6024206845df9142448ba5316e5f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:38.211252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:38.244335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d260f8-f5f0-46c5-aaf9-cb0d34fc8538 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:38.249374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a75b7-6512-4990-a847-00278645efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:38.250760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a75b7-6512-4990-a847-00278645efae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:38.251050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a75b7-6512-4990-a847-00278645efae admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:38.251638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a75b7-6512-4990-a847-00278645efae admin admin] PATH_INFO: `/v3/users/16e726872ed14e52bc6d917042210976` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:38.253112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a75b7-6512-4990-a847-00278645efae admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e726872ed14e52bc6d917042210976)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:38.255270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a75b7-6512-4990-a847-00278645efae admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:38.331396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55aa6024206845df9142448ba5316e5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.332213 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55aa6024206845df9142448ba5316e5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.332965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55aa6024206845df9142448ba5316e5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.358209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55aa6024206845df9142448ba5316e5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.383734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcd832de-1fc0-4b75-9d8a-47a6e7540f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55aa6024206845df9142448ba5316e5f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.387657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e726872ed14e52bc6d917042210976'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.408643 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e726872ed14e52bc6d917042210976'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.414917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 921/1831] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:38 2022] DELETE /identity/v3/users/55aa6024206845df9142448ba5316e5f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:38.417046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e726872ed14e52bc6d917042210976'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.419328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:38.420119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:38.420119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:38.441922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e726872ed14e52bc6d917042210976'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.444606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e726872ed14e52bc6d917042210976'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:38.452845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:38.454239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:38.456544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 911/1832] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:38 2022] DELETE /identity/v3/users/16e726872ed14e52bc6d917042210976 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:38.620675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 922/1833] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:38.716079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:38.717523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:38.730174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:38.823614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a75b7-6512-4990-a847-00278645efae admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:38.827543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:38.828926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:38.829504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:38.830242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:38.843876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:38.845335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:38.858327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 912/1834] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:39.185480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.188030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:39.215753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81b56e-6257-4eb7-bdd3-fcd9cd35754c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:39.233793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:39.234905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.235793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.235793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] PATH_INFO: `/v3/users/c1aa3fa6def84303b9ccbae7e5489fa2` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.237222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1aa3fa6def84303b9ccbae7e5489fa2)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:39.243316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:39.280248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.281658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:39.312025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20611-b0bf-4329-a636-16bc1fb6d88a service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:39.324501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:39.326096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.327116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.327680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] PATH_INFO: `/v3/projects/bc4663086c734b35b368318524e239c1` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.329108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4663086c734b35b368318524e239c1)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:39.332861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:39.369342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:39.372208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1aa3fa6def84303b9ccbae7e5489fa2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.374718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1aa3fa6def84303b9ccbae7e5489fa2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.377880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1aa3fa6def84303b9ccbae7e5489fa2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.408562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1aa3fa6def84303b9ccbae7e5489fa2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.428342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e5acc28-c345-4d07-8b7b-0e8c84ba4456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1aa3fa6def84303b9ccbae7e5489fa2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.459533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 923/1835] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:39 2022] DELETE /identity/v3/users/c1aa3fa6def84303b9ccbae7e5489fa2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:39.464839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d91a3-68ab-4576-a9bf-97c664d476c8 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.465507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d91a3-68ab-4576-a9bf-97c664d476c8 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.465805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d91a3-68ab-4576-a9bf-97c664d476c8 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.470512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 924/1836] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:00:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:00:39.496277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4663086c734b35b368318524e239c1', 'request_id': 'req-adae3c31-08b4-4ab5-afec-b299a0a310ea'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.499509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaf2a-03fb-49ec-b0d8-9bff39685a44 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.500505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaf2a-03fb-49ec-b0d8-9bff39685a44 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.500505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caaf2a-03fb-49ec-b0d8-9bff39685a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.523010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4663086c734b35b368318524e239c1', 'request_id': 'req-adae3c31-08b4-4ab5-afec-b299a0a310ea'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.534562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-90caaf2a-03fb-49ec-b0d8-9bff39685a44 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:39.536402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-90caaf2a-03fb-49ec-b0d8-9bff39685a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:39.539018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4663086c734b35b368318524e239c1', 'request_id': 'req-adae3c31-08b4-4ab5-afec-b299a0a310ea'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.563907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] The token cache is being invalidate because project bc4663086c734b35b368318524e239c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:39.566369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.568791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adae3c31-08b4-4ab5-afec-b299a0a310ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:39.573064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 913/1837] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:39 2022] DELETE /identity/v3/projects/bc4663086c734b35b368318524e239c1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:39.578167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.580636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.581037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.619757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:39.621410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:39.644873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 925/1838] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:39.703357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 914/1839] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:39.712540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.712826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.713101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.737563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:39.738872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:39.755963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 926/1840] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:39.756973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.768756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97644-ac3c-49fc-b584-3a5ab5f1987c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:39.773762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:39.774491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.774766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.775041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.775769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:39.776288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:39.778036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:39.793997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 915/1841] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:00:39.799153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.813571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b86f3-6750-4cd2-859f-ef133256616c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:39.823692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:39.825065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:39.825065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:39.825436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:39.825953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:39.828072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:39.868110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 927/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:39 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:39.872882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.886928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ac04-0d3e-4839-a2a8-3016b9ee7f44 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:39.917184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:39.932746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:39.934857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:40.023067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.024228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.024823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.025702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.026700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.033384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.094196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 916/1843] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:39 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:40.097439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.106627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a440c9-68c2-43b2-8c6c-4bc98ba8ab11 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.114391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.116308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.116699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.117075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] PATH_INFO: `/v3/projects/56751b58f32643429c02321c5273de73` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.118385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a172b82-a0ee-4367-94b5-f435eccea2e4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.118626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56751b58f32643429c02321c5273de73)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.121315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.133317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.135307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.136649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.137316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.150675 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.154525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.171595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:40.172810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 917/1844] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:40.177414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.202644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d207b-793a-4465-a135-c51079e22624 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.211191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56751b58f32643429c02321c5273de73', 'request_id': 'req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.229779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56751b58f32643429c02321c5273de73', 'request_id': 'req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.307457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56751b58f32643429c02321c5273de73', 'request_id': 'req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.361724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] The token cache is being invalidate because project 56751b58f32643429c02321c5273de73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:40.362064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.362973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.369165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 928/1845] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:39 2022] DELETE /identity/v3/projects/56751b58f32643429c02321c5273de73 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:40.370060 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.371524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:40.477434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.478301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.479157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.479446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.480295 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.499162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8880ec-4ffa-4d8f-8568-d9a582b52f4c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.505654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.506421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.506612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.506912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.507197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] PATH_INFO: `/v3/projects/3692370204014c03a4276073b7448aab` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.508928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3692370204014c03a4276073b7448aab)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.510452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.532108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 918/1846] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:40.532108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.533988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:40.551134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a99-91a2-4a99-9b17-c54ed650b807 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.556793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:40.557741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.558029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.558341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] PATH_INFO: `/v3/users/bec3bb27eb104ecfa4fa04e41eafc8fc` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.559644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec3bb27eb104ecfa4fa04e41eafc8fc)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:40.573906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:40.597894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3692370204014c03a4276073b7448aab', 'request_id': 'req-81ea4122-c080-4245-9859-3792b4a1e28c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.612092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3692370204014c03a4276073b7448aab', 'request_id': 'req-81ea4122-c080-4245-9859-3792b4a1e28c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.638187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3692370204014c03a4276073b7448aab', 'request_id': 'req-81ea4122-c080-4245-9859-3792b4a1e28c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.664991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec3bb27eb104ecfa4fa04e41eafc8fc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.668495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] The token cache is being invalidate because project 3692370204014c03a4276073b7448aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:40.668795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.672014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.677021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 929/1847] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:40 2022] DELETE /identity/v3/projects/3692370204014c03a4276073b7448aab => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:40.677640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.681808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:40.682845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec3bb27eb104ecfa4fa04e41eafc8fc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.702148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec3bb27eb104ecfa4fa04e41eafc8fc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.715523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec3bb27eb104ecfa4fa04e41eafc8fc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.716313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a6c793-3c96-450b-a11d-d1c7ae99458b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec3bb27eb104ecfa4fa04e41eafc8fc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:40.738929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 919/1848] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:40 2022] DELETE /identity/v3/users/bec3bb27eb104ecfa4fa04e41eafc8fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:40.740832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:40.741184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:40.741685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:40.791305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:40.807258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:40.808618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:40.858463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:40.934586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea4122-c080-4245-9859-3792b4a1e28c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:40.972127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 920/1849] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:40.973161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:40.990897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.000702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.002457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.002748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.003031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] PATH_INFO: `/v3/projects/3b9176e077784389be9f2b99fbcd7814/users/5b3c84b3b86140eab91f7112f9208b29/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.033667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9176e077784389be9f2b99fbcd7814, user_id=5b3c84b3b86140eab91f7112f9208b29, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:41.036468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef448f-1009-4793-89c6-de4974817da6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:41.075352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 930/1850] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:40 2022] PUT /identity/v3/projects/3b9176e077784389be9f2b99fbcd7814/users/5b3c84b3b86140eab91f7112f9208b29/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:41.075352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708ebce-358f-42a8-b599-a2c84c7b1b05 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.075352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708ebce-358f-42a8-b599-a2c84c7b1b05 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.075352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708ebce-358f-42a8-b599-a2c84c7b1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.107189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e708ebce-358f-42a8-b599-a2c84c7b1b05 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:41.108498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e708ebce-358f-42a8-b599-a2c84c7b1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.182795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b381de-f3a4-4ecb-928f-dbe6a8315674 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.236698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 931/1851] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:41.240649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.240741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.240991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.341018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] MFA Rules not processed for user `5b3c84b3b86140eab91f7112f9208b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:41.343247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.427941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.428615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.428950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.429165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.438104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.455211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:41.457084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:41.473362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 932/1852] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:41.475727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:41.491292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b28ca-3e12-4690-9994-09fe4202ebd3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.494276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 921/1853] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:41.495252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:41.498891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.507098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.510320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.510829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.513287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.514183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:41.514703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:41.521831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:41.557523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a922ed2-177a-425f-ae50-76a49e451547 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.564501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 933/1854] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:41.566069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:41.577693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.578584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.582366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.582764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.583712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:41.586894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:41.605136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab08a-8159-4d75-9aea-d4cb178d16d1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.628760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.635684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.636411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.637067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.638294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:41.642704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:41.648307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 922/1855] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:41 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:41.649294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:41.656844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:41.706324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:41.725102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 934/1856] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:41 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:41.726401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:41.847601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:41.937347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cfc45-c75f-4033-8171-c1d819554447 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.980787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11f31a-0427-40c9-89e9-1e3b27308bd3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:41.991341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:41.992175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:41.993000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:41.993386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:41.994245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.000091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.066560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 935/1857] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:41 2022] POST /identity/v3/users => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:42.067724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.080282 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.081443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.083076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.083687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] PATH_INFO: `/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.086783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5796b8daa8d42f2b681adf4e2218b5a)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.089212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb480-6af5-47f9-8b45-2b4c61aae129 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.091659 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.104679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.105827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.106540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.107120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.108019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.110317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.167397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 936/1858] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:42 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:42.168583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.208217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6879fd-6207-4e11-b3e1-1c6aea32fee7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.208459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5796b8daa8d42f2b681adf4e2218b5a', 'request_id': 'req-80db2b99-837d-4fce-92aa-8cf35c3727c0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:42.234159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5796b8daa8d42f2b681adf4e2218b5a', 'request_id': 'req-80db2b99-837d-4fce-92aa-8cf35c3727c0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:42.254481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5796b8daa8d42f2b681adf4e2218b5a', 'request_id': 'req-80db2b99-837d-4fce-92aa-8cf35c3727c0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:42.292175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] The token cache is being invalidate because project c5796b8daa8d42f2b681adf4e2218b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:42.292478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:42.294260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:42.299036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 923/1859] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:41 2022] DELETE /identity/v3/projects/c5796b8daa8d42f2b681adf4e2218b5a => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:42.299880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.321256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:42.415856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.417097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.417451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.417684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.418990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.422006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ead9f4-29aa-487e-b46c-31dd48230075 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.453428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 937/1860] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:42.456121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.456533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.457308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.465821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:42.483845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:42.485297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:42.498054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2b99-837d-4fce-92aa-8cf35c3727c0 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.505545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 938/1861] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:42.505545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.506885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:42.514065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.514872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.515234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.515751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.517211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.519640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755d1b-5372-4bc1-ac4a-2a32560ee62b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.527893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf026b-cdde-4a27-806b-dcbb888a5006 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.544496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.545531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.546042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.546421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] PATH_INFO: `/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb/users/ba0d556605da49f7ac955fbcc3147aad/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.551782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 924/1862] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:42.556383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.557066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.557354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.568254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38353ed31f949ae8e6c2a5d34a47dfb, user_id=ba0d556605da49f7ac955fbcc3147aad, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.571151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.592222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 939/1863] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:42 2022] PUT /identity/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb/users/ba0d556605da49f7ac955fbcc3147aad/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:42.593164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.598190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:42.599638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:42.701146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 925/1864] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:42.705445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.710966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6969-a274-4d47-93a1-0f7b0c227272 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.717083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.717768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.717877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6524d3-4697-48a5-8295-ab130a6760ad None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.718040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.723491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.724172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.724456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.724734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.725469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.727743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.728597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.728709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.738461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.743668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 926/1865] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:42.744802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:42.747781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.765328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 940/1866] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:42.767661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.775185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12774705-dc9a-4f04-8e7e-4630b1e35938 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.780337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc179f-22c4-420e-87ad-8e84618aef9c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.786452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.787407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.787693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.787991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] PATH_INFO: `/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb/users/ba0d556605da49f7ac955fbcc3147aad/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.790471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38353ed31f949ae8e6c2a5d34a47dfb, user_id=ba0d556605da49f7ac955fbcc3147aad, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.794865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.802558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.803249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.803536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.803809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.805316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:42.805645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:42.807338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad64315-c06c-4c0f-ad2d-2f44f8002e0d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:42.808962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 941/1867] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:42 2022] PUT /identity/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb/users/ba0d556605da49f7ac955fbcc3147aad/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:42.821581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:42.835868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 927/1868] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:42.837663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.838827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.839298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:42.872506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] MFA Rules not processed for user `ba0d556605da49f7ac955fbcc3147aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:42.874090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:42.945732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94ec99-0c2d-4efc-bed5-76090566ec6e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:42.968240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:42.969172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:42.970427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:42.971220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] PATH_INFO: `/v3/projects/fcbbf023cb9548d8a21064f4da54397d/users/40b6a61a7c6544cfadda340356862a26/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.009743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbbf023cb9548d8a21064f4da54397d, user_id=40b6a61a7c6544cfadda340356862a26, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.012470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.016278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 928/1869] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:43.017776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.030362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a89aa2-344d-4ab1-912c-65501b563240 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.038252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 942/1870] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:42 2022] PUT /identity/v3/projects/fcbbf023cb9548d8a21064f4da54397d/users/40b6a61a7c6544cfadda340356862a26/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:43.039733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.042537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.087669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:43.124572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.124742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.125023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.125448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.126711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.128815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc20a27-cee7-4e93-b176-7cfb9913a8a7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.178916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8f345-17be-4f80-8d62-2969886f2ce4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.185485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.186641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.187179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.188163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.188722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 929/1871] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:43.194010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.194460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.194843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.237242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] MFA Rules not processed for user `40b6a61a7c6544cfadda340356862a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:43.238889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.348698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 930/1872] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:43.350089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.362071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.364017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.386051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 943/1873] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:43.391429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.419979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617ad39-6a9e-4b79-bab5-928ff48995b0 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.450900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:43.498452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02357-2635-472e-b3eb-9ad563c8afb1 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.510455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.511725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.513479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.513707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.514104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.514227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.518541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.518541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.518541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.518845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.518953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.523580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.561011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 944/1874] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:43.562090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.582318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 931/1875] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:43.587470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.612260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27483bd-295d-4fc2-8e26-5c5c5c355631 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.637433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8635-d6fe-4b0b-ab6c-42a2f745f23f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.645367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.646263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.646734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.647082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.647853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.650180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.687317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 945/1876] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:43.687317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.691157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:43.697671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e18d70-403c-47b6-b61a-655b936a9463 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.706746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.707878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.707988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.708360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] PATH_INFO: `/v3/users/5b3c84b3b86140eab91f7112f9208b29` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.709642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3c84b3b86140eab91f7112f9208b29)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.711035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.711792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.711911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.712208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.712555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.713391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.715148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.729544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 932/1877] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:43.729544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.736478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.752593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf42-16b8-4dfb-bc04-8c8e876a5011 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.757710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.758625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.758909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.759186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] PATH_INFO: `/v3/users/11aaa09ce8f4407990df3168e8bb19ad` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.760372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11aaa09ce8f4407990df3168e8bb19ad)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.762339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.771139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3c84b3b86140eab91f7112f9208b29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.771858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3c84b3b86140eab91f7112f9208b29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.772521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3c84b3b86140eab91f7112f9208b29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.784661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3c84b3b86140eab91f7112f9208b29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.792667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3c84b3b86140eab91f7112f9208b29'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.805494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 946/1878] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:43 2022] DELETE /identity/v3/users/5b3c84b3b86140eab91f7112f9208b29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:43.806485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.807872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.813182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11aaa09ce8f4407990df3168e8bb19ad'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.815074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:43.826920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11aaa09ce8f4407990df3168e8bb19ad'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.834851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11aaa09ce8f4407990df3168e8bb19ad'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.841897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11aaa09ce8f4407990df3168e8bb19ad'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.842594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11aaa09ce8f4407990df3168e8bb19ad'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:43.848672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 933/1879] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:43 2022] DELETE /identity/v3/users/11aaa09ce8f4407990df3168e8bb19ad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:43.849540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.850882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.879600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9529-e2fc-4d2b-853c-0f9e5031bf84 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.916893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369552-9270-4f98-a2bc-e81ccc9e38d7 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.921669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.922385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.922772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.923590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.924651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.926397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41b096-aaae-42eb-8760-6edf8a0ef2ef admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.935741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.936410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.936703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.936787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 934/1880] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:43.936982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.937842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:43.937960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.938285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.938633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.940006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6634e-7566-4d9e-8d8d-349177252124 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:43.953174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 947/1881] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:43.953174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.953174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.953174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.956431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:43.957681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.966910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 935/1882] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:43.967800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.976275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:43.977671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:43.979249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe692b-001e-47ed-ba45-160830de8a4f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:43.983946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:43.984837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:43.985121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:43.985945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] PATH_INFO: `/v3/projects/774af026a1d24e1f96ec704964beb323/users/04a1728464f84df79623353b0148da1d/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:43.990196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 948/1883] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:43.990196 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:43.990881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:44.004326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9167b-4fc8-4c9e-a0bf-a437ea9125fa None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.009934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.010658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.010943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.011218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.011316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] RBAC: Authorizing `identity:create_grant(project_id=774af026a1d24e1f96ec704964beb323, user_id=04a1728464f84df79623353b0148da1d, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.011946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.013545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.013898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.028311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 936/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:43 2022] PUT /identity/v3/projects/774af026a1d24e1f96ec704964beb323/users/04a1728464f84df79623353b0148da1d/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:44.029048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.030581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:44.035082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 949/1885] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:44.037824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.040142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:44.059403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:44.103141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8280c-508c-45e3-abc2-4858606c517b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.107763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.108445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.108793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.109134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.137846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1b92d-5fb9-4882-9c52-289b754d6ecd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.143036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.144740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.145105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.145559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.198696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.200458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.200654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:44.214204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 937/1886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:44.215159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.222299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.225391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07d48-4706-414e-8038-4c8131220042 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.227485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e12f-242b-4169-9f41-955218376fe8 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.234092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.235899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.236190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.237067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] PATH_INFO: `/v3/projects/8e5c19033cad49cea3b9cb423240360c/users/791a479363f7447e815e4f34d1cd88db/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.239314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 950/1887] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:44.241206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.241206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.241406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.258140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c19033cad49cea3b9cb423240360c, user_id=791a479363f7447e815e4f34d1cd88db, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.262572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f736a-61ce-42ee-a4be-00d27671e52b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.274489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] MFA Rules not processed for user `04a1728464f84df79623353b0148da1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:44.276333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:44.294607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 938/1888] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:44 2022] PUT /identity/v3/projects/8e5c19033cad49cea3b9cb423240360c/users/791a479363f7447e815e4f34d1cd88db/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:44.306290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.306672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.307055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.341748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] MFA Rules not processed for user `791a479363f7447e815e4f34d1cd88db`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:44.343002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:44.367759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 951/1889] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:44.373996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.387269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657f5c-263f-40c0-8bb2-ed51fd459ad0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.427401 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 939/1890] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:44.433051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.474473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.478670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.479501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.479786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.480533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.481146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:44.484513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.522780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fabc1b-3dc8-4fff-9b63-15409dce2745 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.525102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 952/1891] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:44.529099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.600373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.601049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.601929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.602256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.602959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.605068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.623365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:44.631466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243a513-26b0-4cef-95a9-3ce0d13aa5af admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.638774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.639254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 940/1892] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:44.643622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.645135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.645518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.645877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.647628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.650757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.679381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 953/1893] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:44.680535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.692823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbce07-c566-490e-ba56-51f147f695b1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.725143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e331-e3cb-439f-9401-9b6cccd8d2fa admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.735199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.736476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.736769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.737046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.737744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.739983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.772333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.773310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.774066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.774066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.775992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.778063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.789563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 941/1894] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:44 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:44.793069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 954/1895] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:44.794367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.800138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.810211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7f9a-aa4f-4e22-afb3-59d5914eb0a3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.814679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bed3d-9649-4513-9e5f-40cf558b999d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.816008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.816849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.817253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.817542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.818399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.820043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.821704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.823344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.823998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.824463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] PATH_INFO: `/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0/users/2b8f7293cbfb40309ea8dfe7704dd17b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.832954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 942/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:44.837844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.843755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c31af864aaf4876a32ea914a6e3e7a0, user_id=2b8f7293cbfb40309ea8dfe7704dd17b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.846696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.849557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4a28b-e14b-42e0-8e11-400bb2f055ae admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:44.855267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:44.856260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:44.857354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:44.857354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] PATH_INFO: `/v3/projects/ad9943d55b9e4609b8c55840a856ce4e/users/fa3677a97a55450bbb396fcb857abf9b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:44.865209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 955/1897] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:44 2022] PUT /identity/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0/users/2b8f7293cbfb40309ea8dfe7704dd17b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:44.869618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.878841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9943d55b9e4609b8c55840a856ce4e, user_id=fa3677a97a55450bbb396fcb857abf9b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:44.881644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:44.899129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 943/1898] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:44 2022] PUT /identity/v3/projects/ad9943d55b9e4609b8c55840a856ce4e/users/fa3677a97a55450bbb396fcb857abf9b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:44.903217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:44.950683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:44.991246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4dd91-d604-46c5-a18f-e969f7b21924 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.014034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd45e-a3a5-4307-a538-ed5d3918e341 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.023170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.025473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.025955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.026353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.029945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.034545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.051644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 944/1899] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:45.059882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.078017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de66f-6b11-463f-bdc2-451954687272 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.091073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.092722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.093637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.094590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.094976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.095251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.096089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.097177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.098874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.100133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] PATH_INFO: `/v3/projects/ad9943d55b9e4609b8c55840a856ce4e/users/fa3677a97a55450bbb396fcb857abf9b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.102830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9943d55b9e4609b8c55840a856ce4e, user_id=fa3677a97a55450bbb396fcb857abf9b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.108405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4459e5-db19-4914-9fe5-0dcc18edb1cf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.116381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:45.132735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 956/1900] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:45.138667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.149831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 945/1901] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:45 2022] PUT /identity/v3/projects/ad9943d55b9e4609b8c55840a856ce4e/users/fa3677a97a55450bbb396fcb857abf9b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:45.150514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.150885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.151073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.168493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b063d6-bf6d-466f-904b-5d7a7c73abfb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.268869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] MFA Rules not processed for user `fa3677a97a55450bbb396fcb857abf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:45.270548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.304260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.305463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.305925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.306446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] PATH_INFO: `/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0/users/2b8f7293cbfb40309ea8dfe7704dd17b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.308674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c31af864aaf4876a32ea914a6e3e7a0, user_id=2b8f7293cbfb40309ea8dfe7704dd17b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.311846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.346801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 957/1902] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:45 2022] PUT /identity/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0/users/2b8f7293cbfb40309ea8dfe7704dd17b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:45.347846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.349766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.411044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 946/1903] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:45.411915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.413945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.435448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f2ae8-6e77-4d57-a282-7c8b4baf6299 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.462669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd853d-09fe-4b22-986a-36af30373eaf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.471939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.473625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.474052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.474631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] PATH_INFO: `/v3/projects/3b9176e077784389be9f2b99fbcd7814` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.476352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9176e077784389be9f2b99fbcd7814)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.479134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.522308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.523136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.523429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.523713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] PATH_INFO: `/v3/projects/988ff9776ea7481a9ed94b8697602481` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.525179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988ff9776ea7481a9ed94b8697602481)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.527174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.547002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9176e077784389be9f2b99fbcd7814', 'request_id': 'req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.559594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9176e077784389be9f2b99fbcd7814', 'request_id': 'req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.570507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9176e077784389be9f2b99fbcd7814', 'request_id': 'req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.574592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:45.584954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] The token cache is being invalidate because project 3b9176e077784389be9f2b99fbcd7814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:45.585246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.585950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-71a551a2-a2cc-4fc5-9361-6fa5de5b762e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.587706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988ff9776ea7481a9ed94b8697602481', 'request_id': 'req-1f2386b2-43c3-4d1b-b94c-9728bb89de39'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.590942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 958/1904] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:45 2022] DELETE /identity/v3/projects/3b9176e077784389be9f2b99fbcd7814 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:45.590942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159676-851d-4611-a655-b9597207856d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.590942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159676-851d-4611-a655-b9597207856d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.591626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159676-851d-4611-a655-b9597207856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.597395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988ff9776ea7481a9ed94b8697602481', 'request_id': 'req-1f2386b2-43c3-4d1b-b94c-9728bb89de39'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.606406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988ff9776ea7481a9ed94b8697602481', 'request_id': 'req-1f2386b2-43c3-4d1b-b94c-9728bb89de39'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.621256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] The token cache is being invalidate because project 988ff9776ea7481a9ed94b8697602481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:45.621548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.622270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.624010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 947/1905] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:45 2022] DELETE /identity/v3/projects/988ff9776ea7481a9ed94b8697602481 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:45.624791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.626979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.629393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3b159676-851d-4611-a655-b9597207856d None None] MFA Rules not processed for user `2b8f7293cbfb40309ea8dfe7704dd17b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:45.631515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3b159676-851d-4611-a655-b9597207856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.651063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:45.708288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2386b2-43c3-4d1b-b94c-9728bb89de39 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.712443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.713109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.713394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.713674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.715548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.738036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 959/1906] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:45.742252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159676-851d-4611-a655-b9597207856d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.755480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3b159676-851d-4611-a655-b9597207856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.846605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159676-851d-4611-a655-b9597207856d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.852353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.854483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.867182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.868467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 948/1907] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:45.869271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.869573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.870841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] PATH_INFO: `/v3/users/ba0d556605da49f7ac955fbcc3147aad` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.874276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0d556605da49f7ac955fbcc3147aad)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.878349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.892569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:45.896338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:45.931933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7754bb-39ae-461a-8cdc-bb6d1d88929e service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:45.942315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:45.943414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:45.943706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:45.943985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] PATH_INFO: `/v3/users/c174c9d69ad24d9b814c1915137df6f1` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:45.946898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0d556605da49f7ac955fbcc3147aad'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.947552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c174c9d69ad24d9b814c1915137df6f1)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:45.947662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0d556605da49f7ac955fbcc3147aad'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.948228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0d556605da49f7ac955fbcc3147aad'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.952125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:45.968301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0d556605da49f7ac955fbcc3147aad'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:45.978486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0d556605da49f7ac955fbcc3147aad'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.011345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 960/1908] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:45 2022] DELETE /identity/v3/users/ba0d556605da49f7ac955fbcc3147aad => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:46.012259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:46.014724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:46.088460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:46.089957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c174c9d69ad24d9b814c1915137df6f1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.124526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c174c9d69ad24d9b814c1915137df6f1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.135724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c174c9d69ad24d9b814c1915137df6f1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.137310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:46.150799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4e9c7-bff2-4e8a-a974-4b213b3c35e4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:46.164787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:46.165570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:46.166068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:46.166195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:46.168364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:46.181204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c174c9d69ad24d9b814c1915137df6f1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.182475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c174c9d69ad24d9b814c1915137df6f1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:46.191250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 949/1909] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:45 2022] DELETE /identity/v3/users/c174c9d69ad24d9b814c1915137df6f1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:46.309737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:46.311485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:46.328150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 961/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:46.811316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:46.814474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:46.945284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:46.946764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.041948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42f61c-d312-46e9-a6de-65bcddb121a6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.049888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.050821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.051154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.051484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] PATH_INFO: `/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.053330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38353ed31f949ae8e6c2a5d34a47dfb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.055510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.077888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1a2e-be5d-4cb4-82cd-7e63a7ab8885 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.087281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.088826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.089439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.090136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] PATH_INFO: `/v3/projects/5b91acfa2a9e4fd097f223bdeca87173` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.091941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b91acfa2a9e4fd097f223bdeca87173)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.094101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.149443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38353ed31f949ae8e6c2a5d34a47dfb', 'request_id': 'req-b02148cb-4c6f-4f17-8410-e6108b2dc92b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.165988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38353ed31f949ae8e6c2a5d34a47dfb', 'request_id': 'req-b02148cb-4c6f-4f17-8410-e6108b2dc92b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.177296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38353ed31f949ae8e6c2a5d34a47dfb', 'request_id': 'req-b02148cb-4c6f-4f17-8410-e6108b2dc92b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.192574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b91acfa2a9e4fd097f223bdeca87173', 'request_id': 'req-5df1c1eb-532f-479d-aa79-98217051ae9e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.197207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] The token cache is being invalidate because project c38353ed31f949ae8e6c2a5d34a47dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:47.200671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b91acfa2a9e4fd097f223bdeca87173', 'request_id': 'req-5df1c1eb-532f-479d-aa79-98217051ae9e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.208150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.209097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b02148cb-4c6f-4f17-8410-e6108b2dc92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.214148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 950/1911] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:46 2022] DELETE /identity/v3/projects/c38353ed31f949ae8e6c2a5d34a47dfb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:47.215021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b91acfa2a9e4fd097f223bdeca87173', 'request_id': 'req-5df1c1eb-532f-479d-aa79-98217051ae9e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.222483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668f1c-c095-42a9-b482-c8d9a6e1856f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.222825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668f1c-c095-42a9-b482-c8d9a6e1856f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.223355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668f1c-c095-42a9-b482-c8d9a6e1856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.240972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] The token cache is being invalidate because project 5b91acfa2a9e4fd097f223bdeca87173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:47.241275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.249148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5df1c1eb-532f-479d-aa79-98217051ae9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:47.253364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 962/1912] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:46 2022] DELETE /identity/v3/projects/5b91acfa2a9e4fd097f223bdeca87173 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:47.258144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d300-44c3-40cf-8a67-6428f6fe5e9b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.258468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d300-44c3-40cf-8a67-6428f6fe5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.258752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d300-44c3-40cf-8a67-6428f6fe5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.278155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e5668f1c-c095-42a9-b482-c8d9a6e1856f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:47.279421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e5668f1c-c095-42a9-b482-c8d9a6e1856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.306361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2301d300-44c3-40cf-8a67-6428f6fe5e9b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:47.308411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2301d300-44c3-40cf-8a67-6428f6fe5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.315956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:47.401155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 951/1913] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:47.404127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654739-4403-4173-b306-be2e514108f8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.404567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654739-4403-4173-b306-be2e514108f8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.404795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654739-4403-4173-b306-be2e514108f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.431448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7f654739-4403-4173-b306-be2e514108f8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:47.433760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7f654739-4403-4173-b306-be2e514108f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.459058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 952/1914] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:47.460059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654739-4403-4173-b306-be2e514108f8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.473191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654739-4403-4173-b306-be2e514108f8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.486314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.487956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.488247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.490571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.491827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:47.492158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.494161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 963/1915] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:47.512148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.516986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.517667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.517962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.539152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:47.546520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 953/1916] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:47.550647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.561013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:47.562439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.573753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c50e-df7f-40b7-b626-b43ee8a808ab admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.587021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.587700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.588481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.588772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.589540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.591442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.598249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 964/1917] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:47.600333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.643651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81cf7-dc2f-445f-83b2-34ae7b88c2fc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.656883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.658915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.659219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.659587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.660346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:47.660660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.663430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.685523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 954/1918] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:47.687146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 965/1919] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:47.689614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.694651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.729115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7202-959a-4fdf-bf32-eacd6f75a880 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.840479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad2454-c1c0-4463-9703-d84bfe9c20c2 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.848718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.849483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.849779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.850061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.851270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.853223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.886181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 955/1920] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:47.887294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:47.890843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.914535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.915228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.915522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.915801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.916512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:47.918528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:47.978143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225236b-8660-4b8e-864d-740a0080c0d3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:47.986227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:47.987862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:47.988146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:47.988431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:47.992765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:47.996252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 966/1921] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:47 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:47.997149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.099228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.101330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.116086 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 956/1922] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:48.117348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.135765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252855-7259-4eea-9032-0b78d927fcf2 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.166540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:48.179200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb628a2-ad95-4176-972d-d1a40c77ac4d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.197117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.199995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.200347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.200683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.201441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.230203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.251991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.253363 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.253801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.254443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.256623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.264052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.294668 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 967/1923] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:48.301254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.328959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 957/1924] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:48 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:48.334415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.340952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad6bf4-3b3c-40d7-9224-d371510a62dc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.351479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.353094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.353389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.353673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.354458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.356158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.357037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee861-fe14-43fa-9a2c-553aca2d67cf admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.363384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:48.380932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.383703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 968/1925] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:48.384143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.385070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.387103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.387410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.389597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.396437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.403953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e5c6-56ec-45c2-8487-7f377d2cb484 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.414045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.415289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.415767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.416232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] PATH_INFO: `/v3/projects/80aa392a4ac74360bfe54929b913617f/users/1edf0ad76144401695c140029c4d9c44/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.440641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 958/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:48.441626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.456496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5fc41-b2d8-4ee7-8a3f-a431a41474fc admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.461407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aa392a4ac74360bfe54929b913617f, user_id=1edf0ad76144401695c140029c4d9c44, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.464438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.465126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.465408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.465689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.466498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.468227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.470826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5396c9-324e-4f6a-b8f2-67439ea162d8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.490264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 959/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:48.491589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.506661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed45a-a708-4de7-a2dd-00eb3eae7e64 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:48.508336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 969/1928] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:48 2022] PUT /identity/v3/projects/80aa392a4ac74360bfe54929b913617f/users/1edf0ad76144401695c140029c4d9c44/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:48.513895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.514379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.514708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.577571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:48.581699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:48.607426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:48.608795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.609689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.610218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] PATH_INFO: `/v3/projects/068400e0acf9494ab488bc55d01a0f4b/users/0b7a95691ae14f4faf1263d96ca3c5ce/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.640332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=068400e0acf9494ab488bc55d01a0f4b, user_id=0b7a95691ae14f4faf1263d96ca3c5ce, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:48.645584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c2893-0b62-435d-a13b-6e0c3ce9b39c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:48.689031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 960/1929] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:48 2022] PUT /identity/v3/projects/068400e0acf9494ab488bc55d01a0f4b/users/0b7a95691ae14f4faf1263d96ca3c5ce/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:48.693737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:48.694418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:48.694906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:48.755033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] MFA Rules not processed for user `0b7a95691ae14f4faf1263d96ca3c5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:48.757340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:48.809821 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 970/1930] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:48.821154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.823120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:48.886602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 961/1931] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:48.891166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:48.897199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:48.905072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860697b-b932-4a7d-b555-1cecd93b365b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.006809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28eaf1-0be9-4abd-9083-33c08b583945 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.014042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.014946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.015328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.015948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.017311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.019164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.019752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.023406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.023739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.023924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.047599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.050808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.062082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 962/1932] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:48 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:49.062082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.080704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 971/1933] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:49.175286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838b960-6f06-433b-9a1b-c95033a52684 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.187829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.188635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.188960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.189181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.190011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.192080 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.228705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 963/1934] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:49 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:49.232946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.252769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ffc0-243c-40a8-bff3-e5d9f6e452e9 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.261819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.263220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.264070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.264888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.268362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.271865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.286564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 972/1935] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:49.290410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.302543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e50ec-d5d5-4464-bfec-834029028f5b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.309688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.310740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.311304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.311440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] PATH_INFO: `/v3/projects/5527850ff63b4d64a36b07089d337fc1/users/c4b1e8d6c56c4e8983e8b7c915de5cc1/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.341406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5527850ff63b4d64a36b07089d337fc1, user_id=c4b1e8d6c56c4e8983e8b7c915de5cc1, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.351408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.372055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 964/1936] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:49 2022] PUT /identity/v3/projects/5527850ff63b4d64a36b07089d337fc1/users/c4b1e8d6c56c4e8983e8b7c915de5cc1/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:49.379466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.395655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fda3d-cc94-4602-9579-bdfdc3d4d4a3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.439400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:49.506180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.506868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.507152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.507430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.508746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.510914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.518874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.520630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:49.543054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 973/1937] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:49.547331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.575005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fe6de-b0bf-4bc6-b111-5985820a4a01 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.587954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.589013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.589212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.589492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] PATH_INFO: `/v3/projects/5527850ff63b4d64a36b07089d337fc1/users/c4b1e8d6c56c4e8983e8b7c915de5cc1/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.591943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5527850ff63b4d64a36b07089d337fc1, user_id=c4b1e8d6c56c4e8983e8b7c915de5cc1, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.598535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7e47-88c4-4a67-a33a-f0278ea66ca7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.612066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 974/1938] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:49 2022] PUT /identity/v3/projects/5527850ff63b4d64a36b07089d337fc1/users/c4b1e8d6c56c4e8983e8b7c915de5cc1/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:49.623486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.623835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.624194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.648651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793748-8564-4c8c-b1fe-e119bf8fb047 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:49.654978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:49.711635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] MFA Rules not processed for user `c4b1e8d6c56c4e8983e8b7c915de5cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:49.715153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:49.716387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:49.717891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:49.718443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:49.719053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:49.723130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:49.871283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:49.873453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:49.888556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 965/1939] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:49.919248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 975/1940] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:49.980117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:49.981612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:49.986981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.000952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5e516-6897-4f4d-8eec-e370a8cb5b69 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.008293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.011109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.011754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.012250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.038711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.042301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa42f3-1603-43bb-886b-47bef5b6c023 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.074466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 976/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:50.160865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7d59-d5ac-42ad-8f77-d3a0192a1462 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.173578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.176990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.177570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.177570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] PATH_INFO: `/v3/users/04a1728464f84df79623353b0148da1d` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.179814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a1728464f84df79623353b0148da1d)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.181890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.268458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a1728464f84df79623353b0148da1d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:50.284865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:50.288056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a1728464f84df79623353b0148da1d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:50.299354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a1728464f84df79623353b0148da1d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:50.309451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a1728464f84df79623353b0148da1d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:50.310364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18134ab2-365b-473c-8c0b-ea7d1bed8aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a1728464f84df79623353b0148da1d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:50.319627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 966/1942] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:49 2022] DELETE /identity/v3/users/04a1728464f84df79623353b0148da1d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:50.324564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.325499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.325499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.363058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.363375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.363779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.397944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:50.399393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:50.417956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] MFA Rules not processed for user `1edf0ad76144401695c140029c4d9c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:50.420567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:50.541490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 977/1943] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:50.554264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.556049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:50.571757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 967/1944] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:50.576312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.578352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:50.597351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:50.601834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7bb54-a537-4a29-8961-51408b5dba9f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.611596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.612285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.612571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.612848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.613552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.616336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.650147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 968/1945] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:50 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:50.653346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.655472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd23d3-0d46-41bd-9f45-a1324f868602 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.725257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.726030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.726392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.726680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.738009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d2144-a603-4d0a-a5b6-1c9a183222b4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.743219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.748421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.753096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.754179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.754471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.754817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.755680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.757665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.763235 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 978/1946] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:50.789326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 969/1947] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:50 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:50.793397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.818102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a089a-2b97-400b-a672-bd48311ca061 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.862955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.863707 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.864015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.864285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.865345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.867104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.886447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 979/1948] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:50.890209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.916991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eb281-82fc-485d-8925-444bd1561e0c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:50.929245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:50.933557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:50.933908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:50.934258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] PATH_INFO: `/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d/users/6e64e529b5c04cdbb6ded5b97a15ea5c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:50.968751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c87e3ef4e94d15922febb8a620ec1d, user_id=6e64e529b5c04cdbb6ded5b97a15ea5c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:50.980443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:50.987344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:50.993309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:51.010603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 970/1949] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:50 2022] PUT /identity/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d/users/6e64e529b5c04cdbb6ded5b97a15ea5c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:51.012377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ff4e-9b0c-43aa-b27a-2d4bca9ffae2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.014943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:51.061026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:51.168313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.169215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.169491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.169768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] PATH_INFO: `/v3/users/0b7a95691ae14f4faf1263d96ca3c5ce` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.172585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7a95691ae14f4faf1263d96ca3c5ce)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.175526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d17b-f95b-4b89-8d40-2b2210578e5c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.177957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:51.194553 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.198697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.199085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.199579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.200421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.203340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:51.219317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 971/1950] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:51.227029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:51.259078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37081af-f9e7-411b-a2be-6e57a30bd0a1 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.265208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.266464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.266990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.267448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] PATH_INFO: `/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d/users/6e64e529b5c04cdbb6ded5b97a15ea5c/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.269728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c87e3ef4e94d15922febb8a620ec1d, user_id=6e64e529b5c04cdbb6ded5b97a15ea5c, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.273268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:51.289214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 972/1951] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:51 2022] PUT /identity/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d/users/6e64e529b5c04cdbb6ded5b97a15ea5c/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:51.290637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:51.292652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:51.307541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7a95691ae14f4faf1263d96ca3c5ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.307541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7a95691ae14f4faf1263d96ca3c5ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.307541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7a95691ae14f4faf1263d96ca3c5ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.330100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7a95691ae14f4faf1263d96ca3c5ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.339204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:51.344215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a7767d36-7a96-425e-b1dd-41e2ce2efa4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7a95691ae14f4faf1263d96ca3c5ce'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.380458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 980/1952] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:50 2022] DELETE /identity/v3/users/0b7a95691ae14f4faf1263d96ca3c5ce => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:51.388076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.388982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.391814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.449488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:51.467834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:51.487627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504132f-dc88-41d0-ae25-14b3ef405a37 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.615407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 981/1953] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:51.633924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:51.636438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:51.695663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.696591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.696873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.697472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] PATH_INFO: `/v3/projects/774af026a1d24e1f96ec704964beb323` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.701816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774af026a1d24e1f96ec704964beb323)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.704561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:51.762056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfe70d-8c3b-438b-a938-410dc0c1917f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.767176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.767948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.768221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.768611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.779092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:51.784369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.786954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:51.787584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774af026a1d24e1f96ec704964beb323', 'request_id': 'req-42090577-0832-4dba-8790-034303f736a2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.797221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774af026a1d24e1f96ec704964beb323', 'request_id': 'req-42090577-0832-4dba-8790-034303f736a2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.806170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 982/1954] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:51.812702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774af026a1d24e1f96ec704964beb323', 'request_id': 'req-42090577-0832-4dba-8790-034303f736a2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.830330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] The token cache is being invalidate because project 774af026a1d24e1f96ec704964beb323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:51.830921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.832079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:51.840287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 973/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:51 2022] DELETE /identity/v3/projects/774af026a1d24e1f96ec704964beb323 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:51.840426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:51.842026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:51.869031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d53042-c45f-4fa4-8cb4-cd0c3a6e2d41 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:51.947704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:51.948989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:51.949390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:51.949528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] PATH_INFO: `/v3/users/2b8f7293cbfb40309ea8dfe7704dd17b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:51.950829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8f7293cbfb40309ea8dfe7704dd17b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:51.952951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:52.021919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:52.045743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8f7293cbfb40309ea8dfe7704dd17b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.046984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8f7293cbfb40309ea8dfe7704dd17b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.048517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8f7293cbfb40309ea8dfe7704dd17b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.070216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8f7293cbfb40309ea8dfe7704dd17b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.086802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e9334de9-3b2a-48ad-8faa-4a40b0e98f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8f7293cbfb40309ea8dfe7704dd17b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.116384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 983/1956] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:51 2022] DELETE /identity/v3/users/2b8f7293cbfb40309ea8dfe7704dd17b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:52.612720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:52.614658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:52.629473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42090577-0832-4dba-8790-034303f736a2 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:52.692405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:52.692894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:52.693042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:52.717635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:52.718559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:52.718842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:52.719119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] PATH_INFO: `/v3/projects/068400e0acf9494ab488bc55d01a0f4b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:52.720939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=068400e0acf9494ab488bc55d01a0f4b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:52.722889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:52.741479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] MFA Rules not processed for user `6e64e529b5c04cdbb6ded5b97a15ea5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:52.742749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:52.795167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068400e0acf9494ab488bc55d01a0f4b', 'request_id': 'req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.803308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068400e0acf9494ab488bc55d01a0f4b', 'request_id': 'req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.816526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068400e0acf9494ab488bc55d01a0f4b', 'request_id': 'req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.840039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] The token cache is being invalidate because project 068400e0acf9494ab488bc55d01a0f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:52.840334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.845731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:52.850514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 974/1957] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:52 2022] DELETE /identity/v3/projects/068400e0acf9494ab488bc55d01a0f4b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:52.851259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:52.854042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:52.915266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 984/1958] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:52.916334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:52.917898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:52.943493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9ea3-b32e-4e04-90bd-596ff08fe70d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:53.032965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37102-df43-4b39-a6e0-bb4e7cac3ddd admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:53.036263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:53.037608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.038307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.039727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] PATH_INFO: `/v3/users/c4b1e8d6c56c4e8983e8b7c915de5cc1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.041208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b1e8d6c56c4e8983e8b7c915de5cc1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:53.042177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:53.043097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.043381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.043660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] PATH_INFO: `/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.043756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:53.044948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c31af864aaf4876a32ea914a6e3e7a0)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:53.048754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:53.051327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:53.099241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:53.117026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b1e8d6c56c4e8983e8b7c915de5cc1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.117358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b1e8d6c56c4e8983e8b7c915de5cc1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.118356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b1e8d6c56c4e8983e8b7c915de5cc1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.135843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c31af864aaf4876a32ea914a6e3e7a0', 'request_id': 'req-b6a9c129-30bf-4af7-8ec8-a59d54243407'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.145893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c31af864aaf4876a32ea914a6e3e7a0', 'request_id': 'req-b6a9c129-30bf-4af7-8ec8-a59d54243407'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.155769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c31af864aaf4876a32ea914a6e3e7a0', 'request_id': 'req-b6a9c129-30bf-4af7-8ec8-a59d54243407'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.170486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] The token cache is being invalidate because project 2c31af864aaf4876a32ea914a6e3e7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:53.170486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.171588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b6a9c129-30bf-4af7-8ec8-a59d54243407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.173849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 975/1959] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:52 2022] DELETE /identity/v3/projects/2c31af864aaf4876a32ea914a6e3e7a0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:53.175382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.175799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.176211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.196468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b1e8d6c56c4e8983e8b7c915de5cc1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.201152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] MFA Rules not processed for user `1edf0ad76144401695c140029c4d9c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:53.203087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:53.212379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d1fa67fd-0642-4de7-b134-8470c9c5721e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b1e8d6c56c4e8983e8b7c915de5cc1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:53.248117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 985/1960] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:52 2022] DELETE /identity/v3/users/c4b1e8d6c56c4e8983e8b7c915de5cc1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:53.260316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788e5e-15b6-42a0-83ba-f94c7e722e25 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.261931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788e5e-15b6-42a0-83ba-f94c7e722e25 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.262485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe788e5e-15b6-42a0-83ba-f94c7e722e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.306092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 976/1961] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:53.321549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:53.327691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:53.356468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fe788e5e-15b6-42a0-83ba-f94c7e722e25 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:53.358856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fe788e5e-15b6-42a0-83ba-f94c7e722e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:53.538450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a30537-51d9-493e-9d26-0f6631ee5886 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:53.615044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 986/1962] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:53.619153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.619844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.620476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.652428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:53.653911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:53.655141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:53.687959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 987/1963] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:53.696851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:53.730329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:53.731682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.731980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.732315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.733452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e606d8-d989-4d5a-9e4c-c4260839f4a1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:53.737241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:53.751892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:53.753300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.754273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.755433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.756731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:53.757246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:53.775432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:53.852165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:53.853921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:53.855038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 988/1964] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:53.856816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:53.904757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64d0c2-3932-40cd-85f0-002656afc134 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:53.917375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:53.918610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:53.918834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 977/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:53.920498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:53.923121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:53.931449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:53.935329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:53.974828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 989/1966] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:53 2022] POST /identity/v3/projects => generated 359 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:53.981107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.021898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e491-e563-41ee-a266-2d7abed3d8b2 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.091249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.092884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.092884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.092884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.093615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.095771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.143338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 978/1967] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:53 2022] POST /identity/v3/users => generated 280 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:54.147620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.161105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751f2a3-617b-4327-b898-10cbc5336b94 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.167627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.169882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.170236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.170649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.171496 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.173946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.187059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 990/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:54.192443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.208520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d88b5-04a4-457e-8ed5-547e283c54af admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.214141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.214871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.215160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.215470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.216267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.217999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0fe3-30ce-49d0-812c-a2ca3bd97898 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.233207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 979/1969] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:54.238151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.248229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353af91-56c5-4a8e-b197-8822d3a6ab46 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.254066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.254979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.255265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.255539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] PATH_INFO: `/v3/projects/999f4c89419b4b1ca4cd87ce2c53befb/users/2486f43a7489421b9d8d5bf79b98ec28/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.272193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999f4c89419b4b1ca4cd87ce2c53befb, user_id=2486f43a7489421b9d8d5bf79b98ec28, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.274906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.288476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 991/1970] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:54 2022] PUT /identity/v3/projects/999f4c89419b4b1ca4cd87ce2c53befb/users/2486f43a7489421b9d8d5bf79b98ec28/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:54.301586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.301888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.302207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.334273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] MFA Rules not processed for user `2486f43a7489421b9d8d5bf79b98ec28`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:54.335505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:54.386718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:54.420200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 980/1971] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:54.431282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.433051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:54.458442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.460563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:54.497152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:54.550179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81524cc-b983-4f4a-9b80-3b8cff09abe5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.566776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f667e-3b39-41da-b427-792f554d4723 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.576976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.578366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.578872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.579367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] PATH_INFO: `/v3/projects/5527850ff63b4d64a36b07089d337fc1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.581848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5527850ff63b4d64a36b07089d337fc1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.583957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.584207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.585290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.586880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.588183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.613864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.617353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.642830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 981/1972] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:00:54.666636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.698478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d36e21-9136-420f-ab59-1d862edf3148 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.748009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5527850ff63b4d64a36b07089d337fc1', 'request_id': 'req-77604ede-5dc3-482e-8bba-d1f5ac0746e0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.760959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5527850ff63b4d64a36b07089d337fc1', 'request_id': 'req-77604ede-5dc3-482e-8bba-d1f5ac0746e0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.773830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5527850ff63b4d64a36b07089d337fc1', 'request_id': 'req-77604ede-5dc3-482e-8bba-d1f5ac0746e0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.788146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.789061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.789350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.789628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] PATH_INFO: `/v3/users/2486f43a7489421b9d8d5bf79b98ec28` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.790953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2486f43a7489421b9d8d5bf79b98ec28)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.791140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] The token cache is being invalidate because project 5527850ff63b4d64a36b07089d337fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:54.791983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.792857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.793154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.795208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 992/1973] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:54 2022] DELETE /identity/v3/projects/5527850ff63b4d64a36b07089d337fc1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:54.796449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:54.798655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:54.812717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77604ede-5dc3-482e-8bba-d1f5ac0746e0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:54.818579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:54.819485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.819769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.820047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] PATH_INFO: `/v3/users/40b6a61a7c6544cfadda340356862a26` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.821333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b6a61a7c6544cfadda340356862a26)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:54.823441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:54.851196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2486f43a7489421b9d8d5bf79b98ec28'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.867306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2486f43a7489421b9d8d5bf79b98ec28'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.877948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2486f43a7489421b9d8d5bf79b98ec28'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.881628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b6a61a7c6544cfadda340356862a26'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.882334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b6a61a7c6544cfadda340356862a26'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.883097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b6a61a7c6544cfadda340356862a26'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.887256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2486f43a7489421b9d8d5bf79b98ec28'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.888710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e8ad2c8e-adc4-4cbf-b90d-a0e819d88aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2486f43a7489421b9d8d5bf79b98ec28'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.897327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b6a61a7c6544cfadda340356862a26'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.898333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 982/1974] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:54 2022] DELETE /identity/v3/users/2486f43a7489421b9d8d5bf79b98ec28 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:54.900192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0d9-a3c1-4c0f-97be-f201fa2f92e8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.900192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0d9-a3c1-4c0f-97be-f201fa2f92e8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.900394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0d9-a3c1-4c0f-97be-f201fa2f92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.908104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e35dd7a3-b41d-4145-b4c9-b38f50e3e5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b6a61a7c6544cfadda340356862a26'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:54.911195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:54.941887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 993/1975] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:54 2022] DELETE /identity/v3/users/40b6a61a7c6544cfadda340356862a26 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:54.941887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc87cc-2a2c-48a8-a6fa-a939ea7ee152 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:54.941887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc87cc-2a2c-48a8-a6fa-a939ea7ee152 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:54.941887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc87cc-2a2c-48a8-a6fa-a939ea7ee152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:54.943504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ad05c0d9-a3c1-4c0f-97be-f201fa2f92e8 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:54.945012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ad05c0d9-a3c1-4c0f-97be-f201fa2f92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:54.965852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-04dc87cc-2a2c-48a8-a6fa-a939ea7ee152 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:54.968102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-04dc87cc-2a2c-48a8-a6fa-a939ea7ee152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.023792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:55.035406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 983/1976] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:55.036986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.037348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.037716 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.060215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:55.066266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.072168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 994/1977] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:55.073487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.073776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.074054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.096361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 984/1978] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:55.098143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.100472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.121341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:55.123161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.133874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 995/1979] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:55.135099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.136665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.205618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe9fd9-f589-4d19-a10f-fedd6fbc8f88 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.211734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.212813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.212936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.213555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.229083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.231472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.246602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 996/1980] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:55.247620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.261183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307052-5817-4c70-9f8a-7a82a43d768e service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.267261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.267621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef3bb-0d0e-4832-a67c-ef046204d180 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.277687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.287319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.288120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 997/1981] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:55.291569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.291922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.292213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.292764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.318914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.320182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.322517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a733-7ca2-480e-82e0-f1174f78ca7b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.332339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 985/1982] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:55.334599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.337389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.337834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.338278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.341073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.346249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.411897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 998/1983] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:55 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:55.416129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.432751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0036b-7051-4e2c-ae98-a5514b49f376 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.525822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.526945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.527917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.528405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.529333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.532765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.583655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 986/1984] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:55 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:55.588249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.600476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7c330-2ae8-487e-a004-d7950c89012a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.628773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.629550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.630481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.632331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.633394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.637711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.663727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 999/1985] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:55.667806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.691754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757039-7053-4ad6-b252-e9c95b8f368a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.720814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.722649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.722954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.723444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.724309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.726018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951214e8-b8ee-4d33-80e9-6eadfac4f244 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.745908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 987/1986] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:55.749197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:55.769168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35dd7-d49c-424d-a84e-ba1e49de572e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:55.789513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:55.791726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.792033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.792323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] PATH_INFO: `/v3/projects/6ab934e061864d3a849a0d2506b5cee5/users/f82c07c6dbc7440c828ecdc8de6d4000/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.835715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab934e061864d3a849a0d2506b5cee5, user_id=f82c07c6dbc7440c828ecdc8de6d4000, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:55.842785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:55.874556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1000/1987] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:55 2022] PUT /identity/v3/projects/6ab934e061864d3a849a0d2506b5cee5/users/f82c07c6dbc7440c828ecdc8de6d4000/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:55.885513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:55.885850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:55.886294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:55.918628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] MFA Rules not processed for user `f82c07c6dbc7440c828ecdc8de6d4000`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:55.919988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:55.927848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:56.020150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 988/1988] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:56.027671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.029686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.114762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaa142-a2b9-4920-80c6-1ff971648cf8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.118745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.119407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.119690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.120055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.128330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.129829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.140997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.143902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.164763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1001/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:56.197453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.199344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.230300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:56.296922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad1c1-d11a-48e3-8dbd-adc3bbe5efcf None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.312033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.312533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcba2-4e74-4129-8d74-f2c5ea1b1c2d service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.314201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.314670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.315017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] PATH_INFO: `/v3/projects/fcbbf023cb9548d8a21064f4da54397d` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.318513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbbf023cb9548d8a21064f4da54397d)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.318635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.319574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.319867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.320142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] PATH_INFO: `/v3/projects/999f4c89419b4b1ca4cd87ce2c53befb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.321192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.321658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] RBAC: Authorizing `identity:delete_project(project_id=999f4c89419b4b1ca4cd87ce2c53befb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.323671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.396882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999f4c89419b4b1ca4cd87ce2c53befb', 'request_id': 'req-d6a66156-9309-46a0-aa0c-185cabee45da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.413663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999f4c89419b4b1ca4cd87ce2c53befb', 'request_id': 'req-d6a66156-9309-46a0-aa0c-185cabee45da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.419118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbbf023cb9548d8a21064f4da54397d', 'request_id': 'req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.426773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999f4c89419b4b1ca4cd87ce2c53befb', 'request_id': 'req-d6a66156-9309-46a0-aa0c-185cabee45da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.432095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbbf023cb9548d8a21064f4da54397d', 'request_id': 'req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.445771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] The token cache is being invalidate because project 999f4c89419b4b1ca4cd87ce2c53befb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:56.446893 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.448090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d6a66156-9309-46a0-aa0c-185cabee45da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.451045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1002/1990] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:56 2022] DELETE /identity/v3/projects/999f4c89419b4b1ca4cd87ce2c53befb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:56.453386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbbf023cb9548d8a21064f4da54397d', 'request_id': 'req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.458790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378ab9-1dd0-488d-9a99-a95ae902297e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.459163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378ab9-1dd0-488d-9a99-a95ae902297e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.460657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378ab9-1dd0-488d-9a99-a95ae902297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.487471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f7378ab9-1dd0-488d-9a99-a95ae902297e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:56.489027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f7378ab9-1dd0-488d-9a99-a95ae902297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.496528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] The token cache is being invalidate because project fcbbf023cb9548d8a21064f4da54397d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:56.497213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.498597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.505325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 989/1991] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:56 2022] DELETE /identity/v3/projects/fcbbf023cb9548d8a21064f4da54397d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:56.508459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.510615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.584467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:56.595402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1003/1992] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:56.601119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.601427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.601754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.622810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e3210-9d80-43c3-975a-e2ebe0ac9f23 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.629453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.630514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.630880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.631937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] PATH_INFO: `/v3/users/791a479363f7447e815e4f34d1cd88db` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.633570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791a479363f7447e815e4f34d1cd88db)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.635650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.644107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:56.645350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.666974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1004/1993] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:56.668120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.678437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8fe0-b7bb-4e2c-aa1a-73e9b1dab4e9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.683660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.684334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.684620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.684892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.685626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:56.685932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.687609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.706135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1005/1994] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:56.708492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.728133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b772-307f-47a8-8792-0b7afe34136c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.742442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.743123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.743397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.743678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.744361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.746925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:56.750283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791a479363f7447e815e4f34d1cd88db'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.767719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791a479363f7447e815e4f34d1cd88db'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.778642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791a479363f7447e815e4f34d1cd88db'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.787618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:56.799906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791a479363f7447e815e4f34d1cd88db'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.800637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791a479363f7447e815e4f34d1cd88db'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:56.803669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1006/1995] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:56 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:56.808308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:56.810428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:56.811458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 990/1996] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:56 2022] DELETE /identity/v3/users/791a479363f7447e815e4f34d1cd88db => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:56.894910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87dafe-95ec-495c-80fe-5a9c883e8240 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:56.972867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:56.973762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:56.974626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:56.974913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:56.975883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:56.979286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.021409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1007/1997] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:56 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:57.022663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.037351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cb773-eeee-4c1e-a65c-6d7a3e66e4b4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.044921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.045868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.046379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.046867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.047961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.050731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.074530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 991/1998] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:57.078393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.090390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5b8da-4c46-464f-a35b-36afc8b167aa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.097074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.097773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.098084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.098389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.099142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.100778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.112522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1008/1999] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:00:57.117195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.129382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b788c-4ee3-425d-9ee9-0c62650c3c33 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.145188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.146335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.147503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.147969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] PATH_INFO: `/v3/projects/50364e97300f44219a98e8cbb54178a0/users/0f4a67b1bb2a4369b48e9bb7bf659511/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.171563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50364e97300f44219a98e8cbb54178a0, user_id=0f4a67b1bb2a4369b48e9bb7bf659511, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.174875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c120e-57da-43c0-9ff5-ed331f93e01e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.181093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.183543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:57.206089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ccd5-a65b-4ac1-8c7f-f780aff89660 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.220384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 992/2000] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:57 2022] PUT /identity/v3/projects/50364e97300f44219a98e8cbb54178a0/users/0f4a67b1bb2a4369b48e9bb7bf659511/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:57.223406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.223767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.224359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.264193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] MFA Rules not processed for user `0f4a67b1bb2a4369b48e9bb7bf659511`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:57.266809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:57.285546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.286409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.286701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.286981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] PATH_INFO: `/v3/projects/8e5c19033cad49cea3b9cb423240360c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.288208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5c19033cad49cea3b9cb423240360c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.290168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.338184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:57.363957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5c19033cad49cea3b9cb423240360c', 'request_id': 'req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.383472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5c19033cad49cea3b9cb423240360c', 'request_id': 'req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.394828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 993/2001] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:57.395029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5c19033cad49cea3b9cb423240360c', 'request_id': 'req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.410973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] The token cache is being invalidate because project 8e5c19033cad49cea3b9cb423240360c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:57.411846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.412680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.414754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1009/2002] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:57 2022] DELETE /identity/v3/projects/8e5c19033cad49cea3b9cb423240360c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:57.418787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.418986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:57.420497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:57.420946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:57.436361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:57.494061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f69f-1db4-4cec-8adf-3aac11b4a500 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.504187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03c64-e6cc-4f05-b9c8-303fb0cc8c45 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:57.510535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.511548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.512052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.512583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] PATH_INFO: `/v3/users/fa3677a97a55450bbb396fcb857abf9b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.514471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3677a97a55450bbb396fcb857abf9b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.517792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.550075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:57.550846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:57.551287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:57.551568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:57.553452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:57.576465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3677a97a55450bbb396fcb857abf9b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.577479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3677a97a55450bbb396fcb857abf9b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.578231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3677a97a55450bbb396fcb857abf9b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.592797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3677a97a55450bbb396fcb857abf9b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.602951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3677a97a55450bbb396fcb857abf9b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:57.620450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1010/2003] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:00:57 2022] DELETE /identity/v3/users/fa3677a97a55450bbb396fcb857abf9b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:57.649435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:57.651407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e18a4-a349-47fb-98fb-af2838c26026 service glance] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:57.688406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 994/2004] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:00:58.192716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:58.194426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:58.291596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:58.373642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18814b0f-8a4d-488b-91b0-2adf926a2a99 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:58.384100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:58.385257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.385974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.386555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] PATH_INFO: `/v3/projects/ad9943d55b9e4609b8c55840a856ce4e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.388594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9943d55b9e4609b8c55840a856ce4e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:58.392112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:58.474343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9943d55b9e4609b8c55840a856ce4e', 'request_id': 'req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:58.488805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9943d55b9e4609b8c55840a856ce4e', 'request_id': 'req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:58.505256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9943d55b9e4609b8c55840a856ce4e', 'request_id': 'req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:58.524170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] The token cache is being invalidate because project ad9943d55b9e4609b8c55840a856ce4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:00:58.524482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:58.525211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-70051ab0-7c45-48d5-afa5-6bbd8bc6b27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:00:58.530328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1011/2005] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:00:58 2022] DELETE /identity/v3/projects/ad9943d55b9e4609b8c55840a856ce4e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:00:58.532645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.533256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.533256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.569868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:58.571263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:58.666155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 995/2006] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:00:58.670605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.671075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.671679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.693922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:58.695318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:58.707378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1012/2007] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:58.714044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:58.724899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635a65-07a4-41fc-b644-5d51e6142521 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:58.730762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:58.731776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.732220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.732499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.733249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:00:58.733557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:58.735240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:58.749860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 996/2008] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:00:58.754876 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:58.764865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19f501-c76f-4bcd-aaa2-2dc0f2fa15ee None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:58.786534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:58.787259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.787542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.787957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.788663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:58.790636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:58.830816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1013/2009] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:58.831661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:58.845010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63269d-0921-4034-9f39-13bf46e3d22f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:58.852478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:58.924689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:58.925601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:58.926066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:58.926556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:58.927460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:58.930806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:58.966290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 997/2010] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:58 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:00:58.970355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:58.983851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345b11-3bed-4a36-86e4-373d76760ba6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:58.997709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:58.999492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.000030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.001172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.002323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.005003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.025146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.025512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1014/2011] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:59.043232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e90-57bb-4d36-a6a4-1a4173c0eb29 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.051057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.051802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.052149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.052458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.053238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.054895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723cab5-1404-4c0f-be3d-7a2f6dc6d9fa admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.072872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 998/2012] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:59.074053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.085650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf26c7-18b8-421a-8bc6-303981ce2734 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.092058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.092971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.093315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.093610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] PATH_INFO: `/v3/projects/c96fcd529d054edbb0f21d120b3961f8/users/5b38f73e529b46c8bb772870798e64c9/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.122962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96fcd529d054edbb0f21d120b3961f8, user_id=5b38f73e529b46c8bb772870798e64c9, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.130321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.154012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1015/2013] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:59 2022] PUT /identity/v3/projects/c96fcd529d054edbb0f21d120b3961f8/users/5b38f73e529b46c8bb772870798e64c9/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:00:59.165807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545de54-9991-4967-967a-359ed09ff756 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.166131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545de54-9991-4967-967a-359ed09ff756 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.166420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545de54-9991-4967-967a-359ed09ff756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.227800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3545de54-9991-4967-967a-359ed09ff756 None None] MFA Rules not processed for user `5b38f73e529b46c8bb772870798e64c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:00:59.229358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3545de54-9991-4967-967a-359ed09ff756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:00:59.387962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 999/2014] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:00:59.393055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.542509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd8eeb-7efe-48cb-b1e8-dc6a5dd5852d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.559207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.559899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.560276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.560559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.561341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.564055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.569841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:59.634763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1016/2015] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:00:59 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:59.636457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545de54-9991-4967-967a-359ed09ff756 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.653213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545de54-9991-4967-967a-359ed09ff756 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.758421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.767652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.767939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.768215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.768951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.770940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.811925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1000/2016] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:00:59 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:00:59.814260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.834049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0a1c-1a82-4b1e-ab42-5ed35c7d3819 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.853261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.853963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.854289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.854580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.855328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.857098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.899643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1017/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:59.899927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.919489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6b559-e959-4ea0-9263-68a4da57875b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:00:59.949207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:00:59.950482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:00:59.950957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:00:59.951258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:00:59.954459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:00:59.958651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030ac61-4bd8-4fc6-8bbb-9f238f28e0d8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:00:59.960500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:00:59.978783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:00:59.979617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1001/2018] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:00:59.992723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39488ea-b1c9-4ccf-98ec-43ddffaa3da7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.001622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.002702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.002972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.003298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] PATH_INFO: `/v3/projects/cc28826b1a0d41e09a1d6e0fecfe1f7e/users/898c1b93222246e683e850a4ca6208ee/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.031436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc28826b1a0d41e09a1d6e0fecfe1f7e, user_id=898c1b93222246e683e850a4ca6208ee, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.035268 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.065529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1018/2019] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:00:59 2022] PUT /identity/v3/projects/cc28826b1a0d41e09a1d6e0fecfe1f7e/users/898c1b93222246e683e850a4ca6208ee/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:00.068638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.069297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.069849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.150444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] MFA Rules not processed for user `898c1b93222246e683e850a4ca6208ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:00.151686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:00.255605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1002/2020] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:00.260339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.404509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776704a-919e-4c64-9f6c-0bb98566f456 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.411949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.412681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.412969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.413247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.413969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.415990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.467165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1019/2021] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:00.468371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.487557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87b804-2a56-44ba-9f2b-e89f6c26ce1d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.597996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.598804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.600302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.600302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.600302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.602237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.634563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1003/2022] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:00 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:00.638924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.651796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3639-11c8-423a-bb48-cecfaec30b66 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.658253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.659000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.659386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.659766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.660631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.663437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.691395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1020/2023] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:00.695390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.712672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cb58e-9571-4b45-86e9-4fcfe2094caf admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.720600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.722456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.723185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.723892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] PATH_INFO: `/v3/projects/95d3722dad5e41f38932850a2ac7d0f9/users/78896ebc40f9464d83be54d8a7fac058/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.747620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d3722dad5e41f38932850a2ac7d0f9, user_id=78896ebc40f9464d83be54d8a7fac058, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.752700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.792480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1004/2024] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:00 2022] PUT /identity/v3/projects/95d3722dad5e41f38932850a2ac7d0f9/users/78896ebc40f9464d83be54d8a7fac058/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:00.793858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.812164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4b44-af91-4651-8820-d3d7c59a505f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.921641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.924704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.925257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:00.925815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:00.927757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:00.929728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e91ca-4544-48fa-a925-3dbc6e1035e3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:00.972102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1021/2025] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:00.973644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:00.991046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6afd0-509d-476c-9ad6-d30bd619dc11 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:00.997593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:00.998915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:00.999900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:01.000380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] PATH_INFO: `/v3/projects/95d3722dad5e41f38932850a2ac7d0f9/users/78896ebc40f9464d83be54d8a7fac058/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:01.003132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d3722dad5e41f38932850a2ac7d0f9, user_id=78896ebc40f9464d83be54d8a7fac058, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:01.006696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:01.019154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1005/2026] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:00 2022] PUT /identity/v3/projects/95d3722dad5e41f38932850a2ac7d0f9/users/78896ebc40f9464d83be54d8a7fac058/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:01.029837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:01.030308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:01.030578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:01.086708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] MFA Rules not processed for user `78896ebc40f9464d83be54d8a7fac058`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:01.091689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:01.104259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:01.181357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1022/2027] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:01.195412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:01.204252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:01.267307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:01.286376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f046e-5b4f-49ad-8c11-ebe3adcb5b74 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:01.290702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:01.291438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:01.291804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:01.292264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:01.385109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:01.386771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:01.398424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1006/2028] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:02.809527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:02.811128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:02.925024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b345fd-0746-4fde-add3-925d032fcf6b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:02.939637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:02.940546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:02.940834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:02.941125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] PATH_INFO: `/v3/users/f82c07c6dbc7440c828ecdc8de6d4000` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:02.942815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82c07c6dbc7440c828ecdc8de6d4000)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:02.944998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:03.052656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82c07c6dbc7440c828ecdc8de6d4000'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.053759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82c07c6dbc7440c828ecdc8de6d4000'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.055384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82c07c6dbc7440c828ecdc8de6d4000'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.086376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82c07c6dbc7440c828ecdc8de6d4000'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.103330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:03.105005 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.107298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-093526ab-65f0-49be-89e8-3fdeb79ffe28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82c07c6dbc7440c828ecdc8de6d4000'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.135663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283878-edc5-4bf9-8569-43a0651e9eca service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:03.144778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1023/2029] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:02 2022] DELETE /identity/v3/users/f82c07c6dbc7440c828ecdc8de6d4000 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:03.158184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.158184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.158184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.158491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:03.158491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.159059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.159430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] PATH_INFO: `/v3/users/651bbfad0aff4117bc3e85c67e0aae0e` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.161107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] RBAC: Authorizing `identity:delete_user(user_id=651bbfad0aff4117bc3e85c67e0aae0e)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:03.164981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:03.183578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:03.187130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.214989 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:03.251644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651bbfad0aff4117bc3e85c67e0aae0e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.267460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651bbfad0aff4117bc3e85c67e0aae0e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.278647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1024/2030] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:03.278896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:03.280450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.282769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651bbfad0aff4117bc3e85c67e0aae0e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.294422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651bbfad0aff4117bc3e85c67e0aae0e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.295066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651bbfad0aff4117bc3e85c67e0aae0e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.303367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1007/2031] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:03 2022] DELETE /identity/v3/users/651bbfad0aff4117bc3e85c67e0aae0e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:03.304614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:03.305994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.363937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0048-f3f9-4214-b989-9aec0e7480a0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:03.421674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b423-a217-468d-a582-a1f75cf0010a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:03.428580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:03.429250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.429650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.429936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.431947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.450389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:03.451134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.451488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.451857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.453026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:03.455975 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.508731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:03.510088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:03.529246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1008/2032] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:03.558488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:03.561715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5501e-00f1-4e57-8cc3-e3c1dd13bd3d service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:03.563781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:03.565519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.574168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1025/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:03.579966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274280a-78ac-4774-9137-2d6166c4286c service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:03.589346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:03.589974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.590390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.591103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] PATH_INFO: `/v3/projects/a43d2ff60d9844a2855fd4dfb8456bea` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.592284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43d2ff60d9844a2855fd4dfb8456bea)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:03.594345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:03.694569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43d2ff60d9844a2855fd4dfb8456bea', 'request_id': 'req-6b7e890a-8074-49f6-9da6-806046478afa'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.703249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43d2ff60d9844a2855fd4dfb8456bea', 'request_id': 'req-6b7e890a-8074-49f6-9da6-806046478afa'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.718262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43d2ff60d9844a2855fd4dfb8456bea', 'request_id': 'req-6b7e890a-8074-49f6-9da6-806046478afa'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.735235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] The token cache is being invalidate because project a43d2ff60d9844a2855fd4dfb8456bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:03.736703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.737813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6b7e890a-8074-49f6-9da6-806046478afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:03.747839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1009/2034] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:03 2022] DELETE /identity/v3/projects/a43d2ff60d9844a2855fd4dfb8456bea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:03.749719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.750021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.752132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.801868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:03.807620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.867081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:03.911573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1026/2035] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:03.913255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.914413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.914413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.938179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:03.939514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:03.950727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1010/2036] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:03.958435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:03.981406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8995d-ee24-47cb-860b-57b0efdb249c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:03.987187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:03.988063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:03.988442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:03.988935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:03.989996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:03.990405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:03.992099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.006484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1027/2037] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:04.011507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.022309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d839945-77a3-452f-869a-32dac94bc798 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.028025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.028767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.029022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.029241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.030083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.035191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.040604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.044002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.071536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff16a5-4736-4762-8f06-d4dcef72db30 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.079316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1011/2038] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:04.081253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.082555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.082706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.083214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.083758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] PATH_INFO: `/v3/projects/6ab934e061864d3a849a0d2506b5cee5` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.085117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab934e061864d3a849a0d2506b5cee5)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.087205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.196700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab934e061864d3a849a0d2506b5cee5', 'request_id': 'req-15b248f2-af59-4844-ac4b-592737db1867'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:04.215210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab934e061864d3a849a0d2506b5cee5', 'request_id': 'req-15b248f2-af59-4844-ac4b-592737db1867'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:04.228942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab934e061864d3a849a0d2506b5cee5', 'request_id': 'req-15b248f2-af59-4844-ac4b-592737db1867'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:04.249493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] The token cache is being invalidate because project 6ab934e061864d3a849a0d2506b5cee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:04.249826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:04.252618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-15b248f2-af59-4844-ac4b-592737db1867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:04.256984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1028/2039] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:04 2022] DELETE /identity/v3/projects/6ab934e061864d3a849a0d2506b5cee5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:04.262192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0e2c-1ca4-4aad-a69a-4b97a88ad27c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.263675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0e2c-1ca4-4aad-a69a-4b97a88ad27c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.264348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0e2c-1ca4-4aad-a69a-4b97a88ad27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.265182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6bc8-803b-446c-ad27-6055297050e9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.302838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-418d0e2c-1ca4-4aad-a69a-4b97a88ad27c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:04.305649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-418d0e2c-1ca4-4aad-a69a-4b97a88ad27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.315835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:04.429314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1029/2040] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:04.430887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.431266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.433011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.448726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.449424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.449712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.450004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.451152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.452665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.476214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:04.477452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.495242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1030/2041] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:04.496342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.499685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1012/2042] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/users => generated 287 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:04.501174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.508739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288503f-4470-4906-8a6a-86f5fe71b5a0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.510300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.514252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.514966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.515409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.516269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.517299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:04.517632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.519297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.526927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207621f-c067-4a66-9a79-41d753dc6df0 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.534083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1031/2043] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:04.534254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.534790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.535075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.535350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.536078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.537684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.538522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.555928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc97a-5106-4958-9292-2a337d0bdd4a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.560546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1013/2044] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:04.561621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.564394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.564928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.565797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.566278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.566714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.567564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.569956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.606013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1032/2045] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:04.607186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.614481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:04.644430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd16a-10c3-4c86-9ce1-ea747e29663d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.685883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bf9e-02cd-4d73-8d46-15ca0c5ccbff admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.692726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.693406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.693680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.693959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.694737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.696361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.714148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1033/2046] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:04.715133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.718031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.718720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.719097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.720064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.721951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.729080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82ef27-c6cc-43ed-91a4-0d08d18b9665 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.734263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.734263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.734632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.734872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.735625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.739844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.770470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1034/2047] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:04.771371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.783746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57e6e-7698-4df8-91c6-f6081446db07 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.788864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.790156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.790468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.790751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] PATH_INFO: `/v3/projects/d0a9474b4e704c25acfe7d71b835fc24/users/ecfb4712b30143548692669f91bf7cc7/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.807560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.809164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.811562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a9474b4e704c25acfe7d71b835fc24, user_id=ecfb4712b30143548692669f91bf7cc7, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.819950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bf64f-5326-4d55-9723-28f5e2a15e87 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.827306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:04.835100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1014/2048] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:04.837938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.849994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27196ce-5550-414a-8d2c-f2f7a65dfcd6 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.851684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1035/2049] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:04 2022] PUT /identity/v3/projects/d0a9474b4e704c25acfe7d71b835fc24/users/ecfb4712b30143548692669f91bf7cc7/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:04.863632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.864751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.865388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.908941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] MFA Rules not processed for user `ecfb4712b30143548692669f91bf7cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:04.911512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:04.948896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.949820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.950314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.950761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.951631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.954173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:04.970379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1015/2050] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:04.971501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:04.983147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7ca2-0146-4a22-a9a9-94bb782b7257 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:04.990938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:04.992056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:04.992432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:04.992749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:04.993623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:04.995283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.007953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1016/2051] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:05.012141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.013030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1036/2052] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:05.017866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.023503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b3a8a-eaa9-4298-8563-0ff156283a91 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.028705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22441b9-19df-4f33-a0b9-dccf59deea85 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.028855 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.029977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.030446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.030799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] PATH_INFO: `/v3/projects/f4a5c7a573c847168c47c79813c907b6/users/96a0c890f3694ccca22da76c4a2f7a33/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.033760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.034459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.034742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.035020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.035711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.037657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.051104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a5c7a573c847168c47c79813c907b6, user_id=96a0c890f3694ccca22da76c4a2f7a33, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.054381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8148777-772d-404f-99ee-934841be56d2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.066243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1037/2053] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:05 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:05.070041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.079579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1017/2054] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:05 2022] PUT /identity/v3/projects/f4a5c7a573c847168c47c79813c907b6/users/96a0c890f3694ccca22da76c4a2f7a33/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:05.081243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.081534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.081809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.111957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:05.115954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] MFA Rules not processed for user `96a0c890f3694ccca22da76c4a2f7a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:05.117200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:05.156011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa304a-ec16-49b9-8ac3-ad03a738d2f1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.161127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.161798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.162078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.162388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.163084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.165016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.189574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1038/2055] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:05 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:05.193892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.205739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1f77-d2ac-4a7f-b803-becae0d1cad3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.206877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1018/2056] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:05.210789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.211546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.211913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.212259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.213358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.214948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.220491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.222060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:05.229607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1039/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:05.235342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.247740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15ab6e-8507-4f86-8b26-bd124743722e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.253652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.254575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.254861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.255139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] PATH_INFO: `/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4/users/b588f64cf78a41b38e15041b00126941/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.273257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea8fa2742d94cfcb4b9d14cab5f43c4, user_id=b588f64cf78a41b38e15041b00126941, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.278141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.296265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1040/2058] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:05 2022] PUT /identity/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4/users/b588f64cf78a41b38e15041b00126941/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:05.298923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd74a9-eb6f-41c3-922f-d58d6982af04 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.301010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.303128 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:05.368168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.369912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.370239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.370806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.391069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1c2a-7f8b-4fbf-8902-dacea480947f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.396409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.398448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.398732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.399008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.399744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.401474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.419552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1041/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:05.424718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.445115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54855-54c0-47b3-8c92-9674d3dffc99 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.451282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.452194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.452484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.452767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] PATH_INFO: `/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4/users/b588f64cf78a41b38e15041b00126941/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.455081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea8fa2742d94cfcb4b9d14cab5f43c4, user_id=b588f64cf78a41b38e15041b00126941, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.457763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9726054-676d-4e1a-8691-1ac9a74b25b0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.470726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1042/2060] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:05 2022] PUT /identity/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4/users/b588f64cf78a41b38e15041b00126941/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:05.482813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.483538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.483982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.484340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.484623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.497231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1019/2061] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:01:05.521244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] MFA Rules not processed for user `b588f64cf78a41b38e15041b00126941`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:05.523183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:05.618333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:05.644408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1043/2062] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:05.656470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.667376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48a90-98af-493f-9da8-fbd45dc049b2 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.742804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.743429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.743727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.744116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:05.755697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:05.757155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:05.780021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1020/2063] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:05.919652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:05.931164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fdce4-edc5-49bf-9104-f4e677577c5c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:05.935387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:05.936116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:05.936408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:05.936689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:06.019665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:06.021287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09055a-9937-436d-ad73-d2057d4b4ad0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:06.032080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1044/2064] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:08.950429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:08.951889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:09.030844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649a5f1-4236-473e-976e-97f19112a262 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:09.036432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:09.037378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:09.037660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:09.037931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] PATH_INFO: `/v3/users/5b38f73e529b46c8bb772870798e64c9` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:09.039156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b38f73e529b46c8bb772870798e64c9)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:09.041127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:09.046484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:09.098731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b38f73e529b46c8bb772870798e64c9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.111803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b38f73e529b46c8bb772870798e64c9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.119638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b38f73e529b46c8bb772870798e64c9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.127235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b38f73e529b46c8bb772870798e64c9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.127870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b38f73e529b46c8bb772870798e64c9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.133737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1021/2065] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:08 2022] DELETE /identity/v3/users/5b38f73e529b46c8bb772870798e64c9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:09.138281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:09.138799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:09.138964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:09.157004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:09.158227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:09.218319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1045/2066] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:09.228870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:09.230718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:09.288381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66e2d2-9da7-4174-9499-9f43a5b32903 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:09.292863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:09.293514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:09.293800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:09.294078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:09.303395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:09.304822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:09.315997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1022/2067] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:09.673258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:09.674932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:09.690465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c518-6c3b-4158-abed-279b1dea6533 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:09.695925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:09.697167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:09.697699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:09.698080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] PATH_INFO: `/v3/projects/c96fcd529d054edbb0f21d120b3961f8` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:09.699604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96fcd529d054edbb0f21d120b3961f8)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:09.701719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:09.768259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96fcd529d054edbb0f21d120b3961f8', 'request_id': 'req-b7ae784c-b902-4b12-9335-161d07eec083'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.774237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96fcd529d054edbb0f21d120b3961f8', 'request_id': 'req-b7ae784c-b902-4b12-9335-161d07eec083'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.784287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96fcd529d054edbb0f21d120b3961f8', 'request_id': 'req-b7ae784c-b902-4b12-9335-161d07eec083'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.799075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] The token cache is being invalidate because project c96fcd529d054edbb0f21d120b3961f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:09.799478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.800178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.801719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1046/2068] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:09 2022] DELETE /identity/v3/projects/c96fcd529d054edbb0f21d120b3961f8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:09.805819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:09.816394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b69780-c545-45b3-ae5e-2bd4945e12c1 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:09.873098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:09.873980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:09.874303 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:09.874585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] PATH_INFO: `/v3/users/898c1b93222246e683e850a4ca6208ee` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:09.876308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=898c1b93222246e683e850a4ca6208ee)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:09.878253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:09.907360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:09.927191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898c1b93222246e683e850a4ca6208ee'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.939963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898c1b93222246e683e850a4ca6208ee'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.947225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898c1b93222246e683e850a4ca6208ee'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.956091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898c1b93222246e683e850a4ca6208ee'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.956903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898c1b93222246e683e850a4ca6208ee'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:09.963706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1023/2069] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:09 2022] DELETE /identity/v3/users/898c1b93222246e683e850a4ca6208ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:10.248464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:10.250883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:10.265302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae784c-b902-4b12-9335-161d07eec083 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:10.275074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:10.334843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:10.335839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:10.336193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:10.336399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] PATH_INFO: `/v3/projects/cc28826b1a0d41e09a1d6e0fecfe1f7e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:10.337927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc28826b1a0d41e09a1d6e0fecfe1f7e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:10.340130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:10.392332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc28826b1a0d41e09a1d6e0fecfe1f7e', 'request_id': 'req-1af00f51-cc4b-497f-9913-07e4e6c639ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.399739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc28826b1a0d41e09a1d6e0fecfe1f7e', 'request_id': 'req-1af00f51-cc4b-497f-9913-07e4e6c639ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.414185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc28826b1a0d41e09a1d6e0fecfe1f7e', 'request_id': 'req-1af00f51-cc4b-497f-9913-07e4e6c639ae'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.426829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] The token cache is being invalidate because project cc28826b1a0d41e09a1d6e0fecfe1f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:10.427118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.427783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.429546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1047/2070] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:10 2022] DELETE /identity/v3/projects/cc28826b1a0d41e09a1d6e0fecfe1f7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:10.433413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:10.435033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:10.449757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b032c-1d58-4751-bf2c-e6a2d6f1f7ab admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:10.511203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:10.512100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:10.512390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:10.512668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] PATH_INFO: `/v3/users/78896ebc40f9464d83be54d8a7fac058` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:10.514368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78896ebc40f9464d83be54d8a7fac058)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:10.516593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:10.581707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78896ebc40f9464d83be54d8a7fac058'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.598159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78896ebc40f9464d83be54d8a7fac058'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.612054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78896ebc40f9464d83be54d8a7fac058'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.623241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78896ebc40f9464d83be54d8a7fac058'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.624017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a301d030-e65b-4096-b4af-b124aaf69b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78896ebc40f9464d83be54d8a7fac058'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:10.631485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1024/2071] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:10 2022] DELETE /identity/v3/users/78896ebc40f9464d83be54d8a7fac058 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:11.019299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.021011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:11.058319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00f51-cc4b-497f-9913-07e4e6c639ae admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.151679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.152647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.152943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.153242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] PATH_INFO: `/v3/projects/95d3722dad5e41f38932850a2ac7d0f9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.154850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d3722dad5e41f38932850a2ac7d0f9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.158539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.212576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:11.218077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d3722dad5e41f38932850a2ac7d0f9', 'request_id': 'req-797c2b91-8532-4ad7-9af9-f751d4b5c915'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:11.228040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d3722dad5e41f38932850a2ac7d0f9', 'request_id': 'req-797c2b91-8532-4ad7-9af9-f751d4b5c915'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:11.235636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d3722dad5e41f38932850a2ac7d0f9', 'request_id': 'req-797c2b91-8532-4ad7-9af9-f751d4b5c915'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:11.249330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] The token cache is being invalidate because project 95d3722dad5e41f38932850a2ac7d0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:11.250040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:11.250454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-797c2b91-8532-4ad7-9af9-f751d4b5c915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:11.252276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1048/2072] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:11 2022] DELETE /identity/v3/projects/95d3722dad5e41f38932850a2ac7d0f9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:11.257001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.257459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.257551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.282318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:11.283707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:11.304703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:11.360988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1025/2073] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:11.367148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.367491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.367771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.388329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:11.389551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:11.398343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1049/2074] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:11.402514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.413241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794decfa-44dd-41b3-8ac7-500b26db1345 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.418339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.419133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.419451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.419726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.420515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:11.421022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.423008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.435159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1026/2075] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:11.440682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.449935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6748857-c762-4fb8-b670-e4527123a420 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.455829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.456472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.456752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.457021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.457705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.459629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.484069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1050/2076] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:11 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:11.488567 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.498979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4bb8-5072-43d1-9c94-5c0e97f3c08a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.559272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.559963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.560265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.560539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.561238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.564177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.587642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1027/2077] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:11 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:11.589140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.601074 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7ada-5c07-4f76-a300-013a603625b4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.606355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.607170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.607478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.607889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.608776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.610648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.623054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1051/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:11.627610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.638412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc7ea-2879-4366-b943-96a96e6a5f27 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.643984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.644685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.644996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.645285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.646203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.647910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8323ed-5c82-412f-8516-cce306d73c18 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.658609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1028/2079] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:11.663004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.674086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fd7-7008-41b8-92bd-88e4d86884af admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.678914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.679824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.680103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.680382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] PATH_INFO: `/v3/projects/54d978fe542245cdba7d0caa67e72f8f/users/a1f1975ba03f45c8a7a409e0ee86da30/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.697125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d978fe542245cdba7d0caa67e72f8f, user_id=a1f1975ba03f45c8a7a409e0ee86da30, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.699792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.712219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1052/2080] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:11 2022] PUT /identity/v3/projects/54d978fe542245cdba7d0caa67e72f8f/users/a1f1975ba03f45c8a7a409e0ee86da30/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:11.723237 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.723532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.723814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.752735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] MFA Rules not processed for user `a1f1975ba03f45c8a7a409e0ee86da30`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:11.754073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:11.823314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1029/2081] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:11.835092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:11.836785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:11.897477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb83f2d-1855-4292-880c-aeef8584a339 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:11.900714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:11.901381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:11.901671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:11.901954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:11.912660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:11.914156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:11.925498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1053/2082] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:12.963309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:12.973463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a174b-99bc-4f24-aac6-cdd3497f6e6a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:12.978495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:12.979137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:12.979424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:12.979703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:12.981469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:12.999416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:13.050431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:13.051897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb238c5c-8723-4ba2-b8d6-47dc8ed5ba31 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:13.064645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1030/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:17.814851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:17.816291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:17.886028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21096e0-34ab-4eac-b1dd-c7b7f7226282 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:17.891322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:17.892201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:17.892472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:17.892751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] PATH_INFO: `/v3/users/96a0c890f3694ccca22da76c4a2f7a33` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:17.894044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a0c890f3694ccca22da76c4a2f7a33)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:17.896483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:17.913305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:17.966583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a0c890f3694ccca22da76c4a2f7a33'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:17.967359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a0c890f3694ccca22da76c4a2f7a33'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:17.968332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a0c890f3694ccca22da76c4a2f7a33'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:17.992407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a0c890f3694ccca22da76c4a2f7a33'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.000350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a0c890f3694ccca22da76c4a2f7a33'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.019706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1054/2084] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:17 2022] DELETE /identity/v3/users/96a0c890f3694ccca22da76c4a2f7a33 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:18.024718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.025563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.025848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.062890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:18.064798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:18.155696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1031/2085] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:18.172781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:18.174499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:18.244471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6954a60-efe0-416f-8789-f2cfc1d718c3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:18.248267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:18.248918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.249246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.249469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.259275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:18.260710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9c481-20a1-46b6-804d-973bc0665264 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:18.272091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1055/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:18.573514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:18.575065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:18.588436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432387d8-c25c-4c2c-ba2b-24a65c34787a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:18.594308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:18.595198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.595486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.595769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] PATH_INFO: `/v3/projects/f4a5c7a573c847168c47c79813c907b6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.596981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a5c7a573c847168c47c79813c907b6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:18.598921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:18.647171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a5c7a573c847168c47c79813c907b6', 'request_id': 'req-1a6d023d-fab9-4bfd-a944-fd984508645c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.653534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a5c7a573c847168c47c79813c907b6', 'request_id': 'req-1a6d023d-fab9-4bfd-a944-fd984508645c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.662058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a5c7a573c847168c47c79813c907b6', 'request_id': 'req-1a6d023d-fab9-4bfd-a944-fd984508645c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.672685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] The token cache is being invalidate because project f4a5c7a573c847168c47c79813c907b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:18.673006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.673798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1a6d023d-fab9-4bfd-a944-fd984508645c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:18.675348 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1032/2087] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:18 2022] DELETE /identity/v3/projects/f4a5c7a573c847168c47c79813c907b6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:18.680138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.680495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.680806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.700587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:18.701788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:18.780302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1056/2088] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:18.783216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.783506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.783782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.803173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:18.804460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:18.813273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1033/2089] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:18.817448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:18.829250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea293-611c-477b-9f81-1ccf75bd454f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:18.833894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:18.834578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.834857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.835130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.835855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:18.836160 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:18.837766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:18.853750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1057/2090] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:18.854877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:18.865883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc43c7-a903-4399-ab68-1fa6b7dc2c92 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:18.870906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:18.871664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.871852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.872153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.873049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:18.875985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:18.906068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1034/2091] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:18 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:18.907639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:18.918048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4172b1-33a1-4519-8a34-9d6ab2b16e9e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:18.939107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:18.984033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:18.984731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:18.985011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:18.985299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:18.985979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:18.987934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:19.021319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1058/2092] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:18 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:19.025650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:19.037611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a02d-3f65-4595-90eb-a682c1c41ebb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:19.043278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:19.043962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:19.044249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:19.044529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:19.045424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:19.047870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:19.050556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:19.065545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1035/2093] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:19.066391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:19.076861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536785c-0e5c-44ab-a294-2279d565958f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:19.082624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:19.083509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:19.083788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:19.084571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:19.085348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:19.087684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899d380-7769-4fa8-88ee-d795a9afb8ff admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:19.100149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1059/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:19.104434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:19.116798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3872-8fc0-470b-83ed-7a2b1eea2f51 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:19.124536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:19.126073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:19.126400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:19.126666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] PATH_INFO: `/v3/projects/03dffa85f1d84eb0aecbf307da15d7d2/users/be5b9b09f9a64fe7b9905240d4e6b25e/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:19.144455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dffa85f1d84eb0aecbf307da15d7d2, user_id=be5b9b09f9a64fe7b9905240d4e6b25e, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:19.147191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:19.165418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1036/2095] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:19 2022] PUT /identity/v3/projects/03dffa85f1d84eb0aecbf307da15d7d2/users/be5b9b09f9a64fe7b9905240d4e6b25e/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:19.176628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:19.176939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:19.177224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:19.208061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] MFA Rules not processed for user `be5b9b09f9a64fe7b9905240d4e6b25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:19.209355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:19.297297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1060/2096] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:19.307951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:19.309604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:19.371130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f2849-1177-4bdb-b4f4-0420e9c2a3ba admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:19.375811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:19.377055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:19.377654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:19.378319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:19.390186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:19.392310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fe176-da29-4a4a-82cb-f63106cb8ebe service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:19.402915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1037/2097] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:22.483400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:22.546106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41510f2-c324-4627-8bbc-8db9a84be293 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:22.551142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:22.551997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:22.552274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:22.552547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] PATH_INFO: `/v3/users/be5b9b09f9a64fe7b9905240d4e6b25e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:22.553735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5b9b09f9a64fe7b9905240d4e6b25e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:22.555690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:22.588797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:22.603002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5b9b09f9a64fe7b9905240d4e6b25e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:22.603649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5b9b09f9a64fe7b9905240d4e6b25e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:22.604255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5b9b09f9a64fe7b9905240d4e6b25e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:22.616459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5b9b09f9a64fe7b9905240d4e6b25e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:22.623261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5b9b09f9a64fe7b9905240d4e6b25e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:22.636433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1061/2098] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:22 2022] DELETE /identity/v3/users/be5b9b09f9a64fe7b9905240d4e6b25e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:22.641828 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:22.642341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:22.642472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:22.660004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:22.661204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:22.728917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1038/2099] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:22.742807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:22.744370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:22.813926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e075b-ba36-425a-8a41-e8a4fff89b12 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:22.818324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:22.819049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:22.819494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:22.819723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:22.830509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:22.832123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c28d-d00c-424d-a681-1ddb37bc3c9d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:22.842587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1062/2100] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:23.158138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.159692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:23.174786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dca7a-e81f-48c4-bccb-349b48406116 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.185357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.186292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.186777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.187865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] PATH_INFO: `/v3/projects/03dffa85f1d84eb0aecbf307da15d7d2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.189637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dffa85f1d84eb0aecbf307da15d7d2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.191607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.286389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dffa85f1d84eb0aecbf307da15d7d2', 'request_id': 'req-9847c76e-ea55-4823-93de-b75b7ea4434c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:23.294914 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dffa85f1d84eb0aecbf307da15d7d2', 'request_id': 'req-9847c76e-ea55-4823-93de-b75b7ea4434c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:23.305959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dffa85f1d84eb0aecbf307da15d7d2', 'request_id': 'req-9847c76e-ea55-4823-93de-b75b7ea4434c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:23.319304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:23.322184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] The token cache is being invalidate because project 03dffa85f1d84eb0aecbf307da15d7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:23.322796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:23.323799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9847c76e-ea55-4823-93de-b75b7ea4434c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:23.326248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1039/2101] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:23 2022] DELETE /identity/v3/projects/03dffa85f1d84eb0aecbf307da15d7d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:23.332089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.332555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.332935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.351549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:23.352765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:23.425768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1063/2102] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:23.433860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.434183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.434564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.456805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:23.458010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:23.466783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1040/2103] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:23.472480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.485358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9b8a2-2abc-41a8-8feb-92621af33a18 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.492083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.492988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.493277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.493640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.494529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:23.494846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.496470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.512478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1064/2104] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:01:23.518518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.532226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a235f3-0a6f-4a97-a0c5-f022469c9ac5 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.537145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.538146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.538146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.538392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.539104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.541014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.570791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1041/2105] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:23 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:23.575319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.586447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eef6c5-597b-40cd-9e97-d06b170ce6f4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.620926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:23.647129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.647828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.648111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.648389 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.649101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.651055 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.670229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1065/2106] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:23 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:23.674975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.685434 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae582-27d8-4d29-9695-fb7b875f471e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.691315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.691910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.692189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.692478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.693178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.694833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.705968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1042/2107] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:23.710047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.719981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3826c-dfc7-46c1-b043-e512dfe16587 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.724523 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.725227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.725513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.725846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.726669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.728529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe79c7-d08e-4a45-a8bf-147115fb8f34 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.741002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1066/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:23.745309 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.757594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e75c4-c2b4-4691-85b4-a8bed79fde39 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.762274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.763152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.763438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.763713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] PATH_INFO: `/v3/projects/e19b82390f674beeb1724b2b126095b0/users/7f2fcd2c5c494f20b6c370ea9553e8c2/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.779667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19b82390f674beeb1724b2b126095b0, user_id=7f2fcd2c5c494f20b6c370ea9553e8c2, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.782407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:23.796075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1043/2109] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:23 2022] PUT /identity/v3/projects/e19b82390f674beeb1724b2b126095b0/users/7f2fcd2c5c494f20b6c370ea9553e8c2/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:23.807816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.808054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.808330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.835443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] MFA Rules not processed for user `7f2fcd2c5c494f20b6c370ea9553e8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:23.836649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:23.905163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1067/2110] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:23.917829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:23.919625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:23.981532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812b533-5ae6-4aee-8f9b-d9e1b88a8574 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:23.986046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:23.986737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:23.987020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:23.987296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:23.996726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:23.998187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04c6d-d2d4-40c2-8964-790f9045ba89 service glance] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:24.008279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1044/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:30.697886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:30.699545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:30.770091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b9125-bfee-4a11-a3ba-3bbc565ae676 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:30.775225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:30.776258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:30.776546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:30.776823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] PATH_INFO: `/v3/users/0f4a67b1bb2a4369b48e9bb7bf659511` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:30.778073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4a67b1bb2a4369b48e9bb7bf659511)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:30.780050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:30.836623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4a67b1bb2a4369b48e9bb7bf659511'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:30.837289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4a67b1bb2a4369b48e9bb7bf659511'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:30.837901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4a67b1bb2a4369b48e9bb7bf659511'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:30.839072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:30.863182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4a67b1bb2a4369b48e9bb7bf659511'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:30.871002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4a67b1bb2a4369b48e9bb7bf659511'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:30.884184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1068/2112] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:30 2022] DELETE /identity/v3/users/0f4a67b1bb2a4369b48e9bb7bf659511 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:30.888706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:30.889196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:30.889288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:30.907109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:30.907918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:30.973325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1045/2113] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:30.983224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:30.985282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:31.047424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d8a6-659a-4d74-bb87-0c17a9ec50c8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:31.051486 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:31.052145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.052432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.052713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.069152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:31.070925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7b13-46f7-4393-a75c-70eb9390e980 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:31.082966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1069/2114] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:31.355731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:31.357268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:31.432701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:31.470084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143e916-dc8a-476b-b33c-99cda7bac8a4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:31.474910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:31.475824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.476100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.476503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] PATH_INFO: `/v3/projects/50364e97300f44219a98e8cbb54178a0` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.477714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50364e97300f44219a98e8cbb54178a0)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:31.479664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:31.531656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50364e97300f44219a98e8cbb54178a0', 'request_id': 'req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:31.538022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50364e97300f44219a98e8cbb54178a0', 'request_id': 'req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:31.547458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50364e97300f44219a98e8cbb54178a0', 'request_id': 'req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:31.569496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] The token cache is being invalidate because project 50364e97300f44219a98e8cbb54178a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:31.569864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:31.571033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60d77d7f-2a6a-4411-87d0-0bc9fbeb539e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:31.573252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1046/2115] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:31 2022] DELETE /identity/v3/projects/50364e97300f44219a98e8cbb54178a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:31.579708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.580283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.580574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.644804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:31.644804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:31.722917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1070/2116] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:31.731735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.732083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.732362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.752466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:31.753665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:31.762077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1047/2117] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:31.767724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:31.777987 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659145af-8b93-4dee-8c3b-6585f7d324d0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:31.788859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:31.789440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.789726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.790017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.790800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:31.791108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:31.792788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:31.806372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1071/2118] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:31.810428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:31.821320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df074d7c-aa1f-4685-8341-75c7afe74bac None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:31.827160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:31.827866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.828310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.828592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.829325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:31.831362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:31.868219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1048/2119] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:31 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:31.872343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:31.883129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3e5af-9f41-470a-b7ec-73b16765b5c7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:31.926219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:31.956635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:31.957312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:31.957591 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:31.957864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:31.958734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:31.960684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:31.980522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1072/2120] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:31 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:31.984804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:31.996942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6968a9-7ba2-4bdc-8e6d-61d296663edb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:32.001715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:32.002410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:32.002689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:32.002964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:32.003683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:32.005270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:32.016605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1049/2121] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:32.020756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:32.032628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206499b-fb32-49fc-bb9c-66e7d663f24e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:32.037318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:32.038014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:32.038328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:32.038605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:32.039344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:32.040963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13b255-8861-4300-8d05-3df7ed0c9cba admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:32.051654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1073/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:32.055995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:32.066456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6681e7-af22-4ade-b204-3db158f59c2b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:32.071192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:32.072066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:32.072382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:32.072664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] PATH_INFO: `/v3/projects/ab58c3fbc57344ee8cae3cd570d5cf17/users/07957287cc144770be1e2c7e20e5a9bd/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:32.088386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab58c3fbc57344ee8cae3cd570d5cf17, user_id=07957287cc144770be1e2c7e20e5a9bd, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:32.091644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:32.109164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1050/2123] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:32 2022] PUT /identity/v3/projects/ab58c3fbc57344ee8cae3cd570d5cf17/users/07957287cc144770be1e2c7e20e5a9bd/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:32.119617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc8a3-085b-4af5-b789-6e49ff5711e6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:32.119914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc8a3-085b-4af5-b789-6e49ff5711e6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:32.120203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc8a3-085b-4af5-b789-6e49ff5711e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:32.154336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-16cbc8a3-085b-4af5-b789-6e49ff5711e6 None None] MFA Rules not processed for user `07957287cc144770be1e2c7e20e5a9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:32.155679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-16cbc8a3-085b-4af5-b789-6e49ff5711e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:32.230590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1074/2124] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:32.243685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:32.245389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:32.312355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:32.330439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bcf43-54cd-49bd-84ae-3511af112069 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:32.334599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:32.335249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:32.335529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:32.335802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:32.345380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:32.346848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0629-1898-4cf2-b784-a8280166adba service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:32.355417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1051/2125] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:34.070363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.070923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.071163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.079415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1075/2126] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:01:34.095306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.095797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.095982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.125543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] MFA Rules not processed for user `e19685a3a9224caaba7399f5aa5a44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:34.125543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:34.168140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:34.172875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:34.215342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1052/2127] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:34.231256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:34.233961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:34.249768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eb07c-24c9-457f-a1e2-99e09428a948 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:34.257340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:34.257970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.258289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.258568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.268516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc556c4-1ef3-4ce0-a6b1-2478907cfa24 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:34.269721 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:34.271392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:34.273544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:34.274662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.275134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.275616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] PATH_INFO: `/v3/users/1edf0ad76144401695c140029c4d9c44` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.277617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edf0ad76144401695c140029c4d9c44)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:34.279709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:34.281888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1053/2128] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:01:34.336614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:34.339185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edf0ad76144401695c140029c4d9c44'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.340090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edf0ad76144401695c140029c4d9c44'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.340969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edf0ad76144401695c140029c4d9c44'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.355942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edf0ad76144401695c140029c4d9c44'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.367606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edf0ad76144401695c140029c4d9c44'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.387380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1076/2129] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:34 2022] DELETE /identity/v3/users/1edf0ad76144401695c140029c4d9c44 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:34.604885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:34.616854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433185-2ae8-4227-b235-fb1ff175f1c0 service placement] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:34.691408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:34.692713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.693135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.693418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] PATH_INFO: `/v3/projects/80aa392a4ac74360bfe54929b913617f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.694889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80aa392a4ac74360bfe54929b913617f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:34.697163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:34.755278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80aa392a4ac74360bfe54929b913617f', 'request_id': 'req-248eb343-10b9-4590-8224-1e0036910024'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.761826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80aa392a4ac74360bfe54929b913617f', 'request_id': 'req-248eb343-10b9-4590-8224-1e0036910024'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.769709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80aa392a4ac74360bfe54929b913617f', 'request_id': 'req-248eb343-10b9-4590-8224-1e0036910024'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.776436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:34.783065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] The token cache is being invalidate because project 80aa392a4ac74360bfe54929b913617f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:34.783671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.784964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.786910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1054/2130] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:34 2022] DELETE /identity/v3/projects/80aa392a4ac74360bfe54929b913617f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:34.791078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:34.792469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:34.805476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9f3b-dd72-4b32-9ef1-e5f350fe591e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:34.864623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:34.865502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.865786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.866063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] PATH_INFO: `/v3/users/6e64e529b5c04cdbb6ded5b97a15ea5c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.867275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e64e529b5c04cdbb6ded5b97a15ea5c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:34.869253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:34.918198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e64e529b5c04cdbb6ded5b97a15ea5c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.918875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e64e529b5c04cdbb6ded5b97a15ea5c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.919473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e64e529b5c04cdbb6ded5b97a15ea5c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.925688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:34.927195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:34.940421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eb343-10b9-4590-8224-1e0036910024 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:34.944531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e64e529b5c04cdbb6ded5b97a15ea5c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.945279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:34.946268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:34.946622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:34.947001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] PATH_INFO: `/v3/users/07957287cc144770be1e2c7e20e5a9bd` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:34.948301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=07957287cc144770be1e2c7e20e5a9bd)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:34.950347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:34.952205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8a524219-bbc4-4318-b9aa-730fe89cc7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e64e529b5c04cdbb6ded5b97a15ea5c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:34.967631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1077/2131] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:34 2022] DELETE /identity/v3/users/6e64e529b5c04cdbb6ded5b97a15ea5c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:35.013414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07957287cc144770be1e2c7e20e5a9bd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.029205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07957287cc144770be1e2c7e20e5a9bd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.035988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07957287cc144770be1e2c7e20e5a9bd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.046150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07957287cc144770be1e2c7e20e5a9bd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.048159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07957287cc144770be1e2c7e20e5a9bd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.057904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1055/2132] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:34 2022] DELETE /identity/v3/users/07957287cc144770be1e2c7e20e5a9bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:35.062867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.063163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.063518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.091052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:35.092434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.134946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:35.163443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1078/2133] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:35.174150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.175899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.190029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.191493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.204582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da005d63-7f5b-4741-aeb7-cf4751a5bec7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.218964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.219855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.220141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.220425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] PATH_INFO: `/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.221810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c87e3ef4e94d15922febb8a620ec1d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.223738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.274302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c87e3ef4e94d15922febb8a620ec1d', 'request_id': 'req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.278032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e75c-5352-4ac1-8b66-cfa41f5252ad admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.280592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c87e3ef4e94d15922febb8a620ec1d', 'request_id': 'req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.290725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c87e3ef4e94d15922febb8a620ec1d', 'request_id': 'req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.303845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] The token cache is being invalidate because project e2c87e3ef4e94d15922febb8a620ec1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:35.304220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.304885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-b78a5ec6-b35d-4c38-9e51-4a022a804e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.306571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1079/2134] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:35 2022] DELETE /identity/v3/projects/e2c87e3ef4e94d15922febb8a620ec1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:35.311576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65123-1a65-46fe-9ea0-8c8aa11a43b7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.311870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65123-1a65-46fe-9ea0-8c8aa11a43b7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.312172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a65123-1a65-46fe-9ea0-8c8aa11a43b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.330135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c5a65123-1a65-46fe-9ea0-8c8aa11a43b7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:35.331351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c5a65123-1a65-46fe-9ea0-8c8aa11a43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.332541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.333201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.333487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.333842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.335651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.355561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:35.405141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1080/2135] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:35.407973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.408264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.408542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.419192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.420696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.431540 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:35.432757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.432898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1056/2136] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:35.443071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1081/2137] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:35.447371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.459495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a20f1-9df2-4e77-84c4-8bc3f37f60d2 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.469778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.470490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.470781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.471057 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.471789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:35.472192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.474154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.490166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1057/2138] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:01:35.492747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.505012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411577d6-0c2f-4eb9-aab7-88e614fa2d62 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.510282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.511249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.511660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.512167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.512723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.514949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.550163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1082/2139] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:35.557531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.570700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d49cce-1167-4a08-abe7-fb25821a320d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.646683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.647371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.647657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.647930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.648655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.650786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.680065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1058/2140] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:35.683903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.702170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2cf-39d7-4712-9449-3209b786b076 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.709255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.710152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.710554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.710932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.712759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.714581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.738487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.738684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1083/2141] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:35.752651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e47561-ff82-4fd5-a315-ccf10625cabb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.759670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.760140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.760649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.761111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.762222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.764279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.767764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.770063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.785457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0662-474f-4640-a2b8-f80c5e9d242f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.790538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.791498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.791845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.792205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] PATH_INFO: `/v3/projects/ab58c3fbc57344ee8cae3cd570d5cf17` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.793635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab58c3fbc57344ee8cae3cd570d5cf17)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.795894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.801276 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1059/2142] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:35.805180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.817982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd20fb-14fa-446f-bb82-77c842942218 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:35.822922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:35.823816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.824101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.824378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] PATH_INFO: `/v3/projects/0c5d8417d32349e7a1bebbdec848735d/users/1e14d05c00d04446a9772f57da7fe7f5/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.841175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5d8417d32349e7a1bebbdec848735d, user_id=1e14d05c00d04446a9772f57da7fe7f5, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:35.844843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999e10-fab1-412e-aef7-3dab0c3bdb0e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:35.846692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:35.860950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1060/2143] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:35 2022] PUT /identity/v3/projects/0c5d8417d32349e7a1bebbdec848735d/users/1e14d05c00d04446a9772f57da7fe7f5/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:35.871935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.872179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.872538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.885500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab58c3fbc57344ee8cae3cd570d5cf17', 'request_id': 'req-11dd9800-cc78-4075-965e-c6ead8c25ec4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.892457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab58c3fbc57344ee8cae3cd570d5cf17', 'request_id': 'req-11dd9800-cc78-4075-965e-c6ead8c25ec4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.903856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab58c3fbc57344ee8cae3cd570d5cf17', 'request_id': 'req-11dd9800-cc78-4075-965e-c6ead8c25ec4'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.905102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] MFA Rules not processed for user `1e14d05c00d04446a9772f57da7fe7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:35.906938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.918014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] The token cache is being invalidate because project ab58c3fbc57344ee8cae3cd570d5cf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:35.918334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.919034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-11dd9800-cc78-4075-965e-c6ead8c25ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:35.920647 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1084/2144] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:35 2022] DELETE /identity/v3/projects/ab58c3fbc57344ee8cae3cd570d5cf17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:35.925903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec512-57fc-4efb-bd97-cce1346b9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:35.926229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec512-57fc-4efb-bd97-cce1346b9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:35.926513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cec512-57fc-4efb-bd97-cce1346b9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:35.946294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-97cec512-57fc-4efb-bd97-cce1346b9cb5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:35.947422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-97cec512-57fc-4efb-bd97-cce1346b9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:35.959624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:35.982481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1061/2145] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:35.987360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:35.989158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.016799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1085/2146] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:36.024762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.025057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.025394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.067204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:36.068450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.074977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497524be-d949-4687-9ebf-f3ef2372f670 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.089322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1086/2147] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:36.091154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.092072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.092901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.094010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.094651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.095101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.097376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.105412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65a03-443c-4054-9bc9-c00d87ae2105 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.110614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.111322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.111646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.111927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.112746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:36.113333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.115251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.133266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1087/2149] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:01:36.133530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1062/2149] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:36.134288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.134400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.144843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3ef6-0e06-4879-afb5-eec9d11811ff admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.217603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.218290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.218581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.219604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.220428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.222443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.224856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461e06-588a-4ac9-ba7d-8b959e538056 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.231227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.232305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.232613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.232901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.233649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.236646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.245127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1088/2150] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:36.248932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.260004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475565e8-c3da-4d1c-b68a-9bb50dd5115b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.266983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1063/2151] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:36.267121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.267121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.267121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.267121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.267409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.268336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.268459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.279425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1089/2152] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:36.283491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.293071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9082-b559-4be5-8e24-9abce4736f22 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.297255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:36.329758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:36.333895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003999c-1a87-4a3e-b298-362a4b93991a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.340035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.340709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.340992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.341277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.341978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.344413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.357265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.358198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.358467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.358809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] PATH_INFO: `/v3/projects/0841ab6a7dca4965a05a957651367a64/users/02cdbf852722436bad3fc831d27d205b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.365416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1064/2153] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:36.371094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.378004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0841ab6a7dca4965a05a957651367a64, user_id=02cdbf852722436bad3fc831d27d205b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.380710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.384985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8b21c-d385-40fa-98aa-b7bf9a67b3fd admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.390485 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.391167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.391453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.391736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.392472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.394069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.394934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1090/2154] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:36 2022] PUT /identity/v3/projects/0841ab6a7dca4965a05a957651367a64/users/02cdbf852722436bad3fc831d27d205b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:36.398964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.408256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1065/2155] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:36.410583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.424314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705c93-c0ea-492d-bad3-e2fdb887a6d3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.476042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726209-f9fd-4f4d-bda0-e6a4a4f85842 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.480836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.481518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.481796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.482070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.482820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.485061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.491384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.492064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.492350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.492628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.493352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.494976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.495742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1091/2156] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:36.499977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.506025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1066/2157] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:36.509729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.509873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b9c14-074f-4166-adbc-d3476d941dd1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.514512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.515503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.515783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.516064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] PATH_INFO: `/v3/projects/0841ab6a7dca4965a05a957651367a64/users/02cdbf852722436bad3fc831d27d205b/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.518034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0841ab6a7dca4965a05a957651367a64, user_id=02cdbf852722436bad3fc831d27d205b, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.519777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e701-03bb-4529-9cd4-25d78a0dd859 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.520702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdecdbc-bd54-4831-b042-7a7476161355 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.524987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.525854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.526176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.526463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] PATH_INFO: `/v3/projects/f80a6168db284f629818111237846592/users/f07cafb516934dc5b905e8ec54266afb/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.532016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1092/2158] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:36 2022] PUT /identity/v3/projects/0841ab6a7dca4965a05a957651367a64/users/02cdbf852722436bad3fc831d27d205b/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:36.542186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.542480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.542811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.542920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80a6168db284f629818111237846592, user_id=f07cafb516934dc5b905e8ec54266afb, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.545497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320155c7-e655-4246-a4fc-f186418a8b05 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.565054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1067/2159] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:36 2022] PUT /identity/v3/projects/f80a6168db284f629818111237846592/users/f07cafb516934dc5b905e8ec54266afb/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:36.569954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.570447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.570776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.572554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] MFA Rules not processed for user `02cdbf852722436bad3fc831d27d205b`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:36.573924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.588230 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:36.589429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.637846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:36.647718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1093/2160] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:36.651892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1068/2161] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:36.661852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.662153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:36.663372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.663492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:36.720095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:36.725019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704ef24-aa0a-448b-bf97-3c6cfbc81ee0 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.725315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271c30-7afc-4f73-bb29-d0afe4a8e9ed None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:36.729500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.729818 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:36.730286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.730629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.730742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:36.730948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.731058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:36.731263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:36.742789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.744305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.754325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1069/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:36.799930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:36.801518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf52e4e-7e62-4fdd-a877-a2bd9a5e07f0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:36.811090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1094/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:37.469381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:37.470982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:37.484753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1c2b-2fe7-4177-ab20-e2954d99949e service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:37.489968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:37.490831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:37.491112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:37.491385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] PATH_INFO: `/v3/users/ecfb4712b30143548692669f91bf7cc7` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:37.492574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfb4712b30143548692669f91bf7cc7)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:37.494751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:37.557867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:37.558521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:37.558521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:37.572766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfb4712b30143548692669f91bf7cc7'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:37.590379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] MFA Rules not processed for user `f07cafb516934dc5b905e8ec54266afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:37.591676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:37.596166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfb4712b30143548692669f91bf7cc7'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:37.608464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfb4712b30143548692669f91bf7cc7'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:37.617916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfb4712b30143548692669f91bf7cc7'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:37.619564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3b45f59c-76e2-48c3-9161-58549fd5c5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfb4712b30143548692669f91bf7cc7'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:37.629753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1070/2164] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:37 2022] DELETE /identity/v3/users/ecfb4712b30143548692669f91bf7cc7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:37.633934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:37.634264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:37.634612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:37.654264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:37.655489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:37.674864 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1095/2165] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:37.685521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:37.688700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:37.701633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65a7d7-b47a-461c-af4b-8739b7af0525 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:37.737602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1071/2166] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:37.746367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:37.747740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:37.757786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:37.769365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:37.770020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:37.770746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:37.771029 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:37.814463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b8f86-8f11-47f5-aa52-3dde6cc7499f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:37.818275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:37.818926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:37.819213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:37.819491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:37.829718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:37.830697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:37.831405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:37.832218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:37.841399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1072/2167] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:01:37.841529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1096/2168] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:01:38.145850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:38.147464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:38.179875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63dcb-c6ad-4db8-9184-6ea7c636b808 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:38.186070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:38.187754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:38.188127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:38.188410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] PATH_INFO: `/v3/projects/d0a9474b4e704c25acfe7d71b835fc24` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:38.201540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a9474b4e704c25acfe7d71b835fc24)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:38.204251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:38.206943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:38.302640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a9474b4e704c25acfe7d71b835fc24', 'request_id': 'req-3d9b5128-521e-491d-aeab-7fa36596f0ef'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.310767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a9474b4e704c25acfe7d71b835fc24', 'request_id': 'req-3d9b5128-521e-491d-aeab-7fa36596f0ef'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.320822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a9474b4e704c25acfe7d71b835fc24', 'request_id': 'req-3d9b5128-521e-491d-aeab-7fa36596f0ef'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.335144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] The token cache is being invalidate because project d0a9474b4e704c25acfe7d71b835fc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:38.335437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.336100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.337669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1073/2169] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:38 2022] DELETE /identity/v3/projects/d0a9474b4e704c25acfe7d71b835fc24 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:38.341620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:38.353171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3642-b9ae-4eb4-beac-3d0fbbf37ff7 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:38.419504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:38.420383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:38.420670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:38.420947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] PATH_INFO: `/v3/users/b588f64cf78a41b38e15041b00126941` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:38.422238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b588f64cf78a41b38e15041b00126941)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:38.424184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:38.475255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b588f64cf78a41b38e15041b00126941'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.475920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b588f64cf78a41b38e15041b00126941'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.476536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b588f64cf78a41b38e15041b00126941'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.489504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b588f64cf78a41b38e15041b00126941'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.497002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-e72797e1-8edc-4f2f-a988-9d2766174c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b588f64cf78a41b38e15041b00126941'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.510639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1097/2170] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:38 2022] DELETE /identity/v3/users/b588f64cf78a41b38e15041b00126941 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:38.834214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:38.835731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:38.849266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b5128-521e-491d-aeab-7fa36596f0ef admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:38.907458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:38.908316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:38.908602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:38.908875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] PATH_INFO: `/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:38.910048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea8fa2742d94cfcb4b9d14cab5f43c4)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:38.911972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:38.959867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea8fa2742d94cfcb4b9d14cab5f43c4', 'request_id': 'req-c567d735-2288-4be2-ac8a-540a3bce0acc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.965982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea8fa2742d94cfcb4b9d14cab5f43c4', 'request_id': 'req-c567d735-2288-4be2-ac8a-540a3bce0acc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.973998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea8fa2742d94cfcb4b9d14cab5f43c4', 'request_id': 'req-c567d735-2288-4be2-ac8a-540a3bce0acc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.985924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] The token cache is being invalidate because project 6ea8fa2742d94cfcb4b9d14cab5f43c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:38.986249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.986902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c567d735-2288-4be2-ac8a-540a3bce0acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:38.988733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1074/2171] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:38 2022] DELETE /identity/v3/projects/6ea8fa2742d94cfcb4b9d14cab5f43c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:38.993632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:38.994127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:38.994218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.015469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:39.016667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:39.025995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:39.082478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1098/2172] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:39.090305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.090592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.090865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.111584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:39.112819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:39.120893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1075/2173] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:39.125095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.134719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23e54-0830-4a1f-8b81-9b091d6ea9e3 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.139225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.139867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.140148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.140421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.141138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:39.141441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.143064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.154416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1099/2174] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:39.159457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.168517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853a08-a574-4b00-a4c4-8f2bec6ab6e2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.175017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.175709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.175993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.176268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.177007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.179037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03913d-0496-4aa4-a093-5bbb83a9b96d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.189618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:39.206602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1076/2175] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:39.210701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.221360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ab97-1d56-4c2e-be2b-05944f84b2ee admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.287414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.287731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.288029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.291390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.292091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.292381 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.292663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.293358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.295330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.307900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] MFA Rules not processed for user `f07cafb516934dc5b905e8ec54266afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:39.309560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:39.322298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1100/2176] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:39.327935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.340444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b4206-da14-453d-909c-701d3476d1c4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.346786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.347455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.347740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.348019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.348754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.350399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.364526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1101/2177] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:39.369017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.386238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe770f-b540-4d75-9de7-a09cdc328d06 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.389246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1077/2178] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:39.391769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.392706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.393064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.393423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.394682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.396398 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5175b77-73fd-444e-a095-cb3286df858e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.413402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1102/2179] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:39.414427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.427258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7de86-00f2-4870-8277-a4ec8341925d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.431861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.432747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.433158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.433481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] PATH_INFO: `/v3/projects/68132cd7d33544b090ef763aa94377aa/users/76040cb50a944774b47514a25bc904e6/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.449084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68132cd7d33544b090ef763aa94377aa, user_id=76040cb50a944774b47514a25bc904e6, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.455952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.467441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1078/2180] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:39 2022] PUT /identity/v3/projects/68132cd7d33544b090ef763aa94377aa/users/76040cb50a944774b47514a25bc904e6/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:39.479865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.480200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.480472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.512617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] MFA Rules not processed for user `76040cb50a944774b47514a25bc904e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:39.513968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:39.580785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:39.585091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1103/2181] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:39.589119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.652945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038b9f1-b53c-487c-bb8a-4c7e72fa3e0e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.658498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.659161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.659448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.659731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.660420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.662353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.690395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1079/2182] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:39.691594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.702247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccc209-df37-4004-ba37-894d18c3d277 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.761310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.761979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.762303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.762583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.763284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.765746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.788014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1104/2183] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:39 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:39.797446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.812857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a647d-f783-4622-9b0d-e5d0beba2dd3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.817686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.818180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.818476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.818754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.819490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.821081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.832972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1080/2184] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:39.837356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.847477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f462dd-f0e6-418b-9e3e-60a753de5891 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.852459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.853408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.853757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.854103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] PATH_INFO: `/v3/projects/751a0d3fe05744df997e123bda0a2777/users/3e0cc0446e234757b782d76cb5381ccc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.869419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a0d3fe05744df997e123bda0a2777, user_id=3e0cc0446e234757b782d76cb5381ccc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.872261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.887902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1105/2185] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:39 2022] PUT /identity/v3/projects/751a0d3fe05744df997e123bda0a2777/users/3e0cc0446e234757b782d76cb5381ccc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:39.892576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:39.903090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8768-a9bd-42e0-a45c-646f13557202 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:39.947740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:39.969756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:39.970589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:39.970845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:39.971145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:39.971915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:39.973665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69047214-c083-4932-b26f-66d4292529bd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:39.986306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1081/2186] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:39.991005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:40.003915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228bf6-4edd-4d7f-9476-a4d5e7c4ba4f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:40.008773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:40.009739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:40.010142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:40.010504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] PATH_INFO: `/v3/projects/751a0d3fe05744df997e123bda0a2777/users/3e0cc0446e234757b782d76cb5381ccc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:40.012672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751a0d3fe05744df997e123bda0a2777, user_id=3e0cc0446e234757b782d76cb5381ccc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:40.016125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:40.029103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1106/2187] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:39 2022] PUT /identity/v3/projects/751a0d3fe05744df997e123bda0a2777/users/3e0cc0446e234757b782d76cb5381ccc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:40.040090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:40.040498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:40.040839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:40.072247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] MFA Rules not processed for user `3e0cc0446e234757b782d76cb5381ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:40.074170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:40.155676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1082/2188] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:40.165631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:40.167380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:40.228950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfe6fb-fcb7-4710-9adc-908da104af00 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:40.232956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:40.234249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:40.234493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:40.234763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:40.244081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:40.245518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:40.255411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1107/2189] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:40.355156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:40.356700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:40.369219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ebd5-040b-4608-9a7e-eb75e4b88fb2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:40.373280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:40.373983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:40.374342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:40.375146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:40.443337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:40.445023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:40.457957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1083/2190] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:41.233053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:41.243200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9d21-a541-43a8-bd95-ffce5563173c service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:41.247234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:41.247952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:41.248271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:41.248585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:41.251709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:41.303973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:41.318350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:41.319781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dc63d-ad75-4ae4-a7a8-2de59c8a7493 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:41.329564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1108/2191] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:43.072402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:43.143112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba171314-0838-45f9-a8c8-e5384aa8775e service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:43.147784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:43.148654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:43.148937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:43.149212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] PATH_INFO: `/v3/users/76040cb50a944774b47514a25bc904e6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:43.150436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76040cb50a944774b47514a25bc904e6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:43.152405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:43.159105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:43.203709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76040cb50a944774b47514a25bc904e6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.215953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76040cb50a944774b47514a25bc904e6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.224245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76040cb50a944774b47514a25bc904e6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.233274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76040cb50a944774b47514a25bc904e6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.233989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76040cb50a944774b47514a25bc904e6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.240163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1084/2192] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:43 2022] DELETE /identity/v3/users/76040cb50a944774b47514a25bc904e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:43.245240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:43.245713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:43.245981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:43.266435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:43.267688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:43.327164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1109/2193] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:43.337758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:43.339178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:43.400904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3212-e2da-4e34-8ecd-fe405fbdb49e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:43.404531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:43.405185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:43.406042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:43.406347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:43.415684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:43.417140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:43.427524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1085/2194] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:43.698912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:43.700393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:43.712446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0efc8-00a2-4dbb-a427-90a745a44de4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:43.717008 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:43.717878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:43.718695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:43.718977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] PATH_INFO: `/v3/projects/68132cd7d33544b090ef763aa94377aa` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:43.720256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68132cd7d33544b090ef763aa94377aa)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:43.722215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:43.769653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68132cd7d33544b090ef763aa94377aa', 'request_id': 'req-25c20234-d2b5-4fb0-91ec-26ded39e719c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.775315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68132cd7d33544b090ef763aa94377aa', 'request_id': 'req-25c20234-d2b5-4fb0-91ec-26ded39e719c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.783854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68132cd7d33544b090ef763aa94377aa', 'request_id': 'req-25c20234-d2b5-4fb0-91ec-26ded39e719c'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.795126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] The token cache is being invalidate because project 68132cd7d33544b090ef763aa94377aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:43.795418 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.796766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.798502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1110/2195] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:43 2022] DELETE /identity/v3/projects/68132cd7d33544b090ef763aa94377aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:43.802541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:43.812257 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed4ab-550b-497b-adb5-2afa6a5f674a service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:43.870165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:43.870960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:43.871249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:43.871526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] PATH_INFO: `/v3/users/3e0cc0446e234757b782d76cb5381ccc` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:43.872707 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0cc0446e234757b782d76cb5381ccc)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:43.875248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:43.909912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:43.925414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0cc0446e234757b782d76cb5381ccc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.941495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0cc0446e234757b782d76cb5381ccc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.958487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0cc0446e234757b782d76cb5381ccc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.966382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0cc0446e234757b782d76cb5381ccc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.967124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5a4ec415-c1e3-4df5-afcc-9b61686bd71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0cc0446e234757b782d76cb5381ccc'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:43.974392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1086/2196] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:43 2022] DELETE /identity/v3/users/3e0cc0446e234757b782d76cb5381ccc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:44.270318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.271882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:44.301962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20234-d2b5-4fb0-91ec-26ded39e719c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.367693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.368555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.368839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.369115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] PATH_INFO: `/v3/projects/751a0d3fe05744df997e123bda0a2777` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.370333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751a0d3fe05744df997e123bda0a2777)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.372316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.390097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:44.425411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751a0d3fe05744df997e123bda0a2777', 'request_id': 'req-c6c4ff39-96a2-46ed-ba1b-1ba253268678'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:44.431126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751a0d3fe05744df997e123bda0a2777', 'request_id': 'req-c6c4ff39-96a2-46ed-ba1b-1ba253268678'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:44.438934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751a0d3fe05744df997e123bda0a2777', 'request_id': 'req-c6c4ff39-96a2-46ed-ba1b-1ba253268678'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:44.450409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] The token cache is being invalidate because project 751a0d3fe05744df997e123bda0a2777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:44.450699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:44.451336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c6c4ff39-96a2-46ed-ba1b-1ba253268678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:44.453104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1111/2197] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:44 2022] DELETE /identity/v3/projects/751a0d3fe05744df997e123bda0a2777 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:44.457919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.458451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.458542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.476270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:44.477475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:44.541480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1087/2198] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:44.549958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.550295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.550581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.570249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:44.573467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:44.581021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1112/2199] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:44.585030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.594884 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b88298-0c33-4abb-a28f-ead60bb27305 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.599605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.600286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.600574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.600856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.601610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:44.601925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.604229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.617798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1088/2200] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:44.621986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.632229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a229-6b25-461b-a87e-7766b49aa8f6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.637056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.637706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.637991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.638302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.639052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.641775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.668367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1113/2201] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:44 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:44.673801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.683933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063deb75-0f76-4e11-8707-253988dfb701 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.742246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.742926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.743228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.743497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.744487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.748477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.772640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1089/2202] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:44 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:44.774672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.791390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc1f4-4b21-405a-9e1b-032b6498405d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.798565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.799246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.799526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.799801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.800532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.802177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.813834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1114/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:44.817941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.831776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad890-9130-47e2-8828-1d3277e80fc9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.836239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.837542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.837542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.837542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.838369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.840335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60321-5952-46a1-9ca8-72e77c6f3a52 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.852832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1090/2204] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:01:44.856936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:44.867394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e38f7f-f65a-4478-ab4b-c4d7c2cbaaeb admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:44.872147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:44.873027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.873307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.873830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] PATH_INFO: `/v3/projects/040c4a51c6e945038da0133cd1a60219/users/c9875e23a5c441d1ad522d1d37aba3db/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.891105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=040c4a51c6e945038da0133cd1a60219, user_id=c9875e23a5c441d1ad522d1d37aba3db, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:44.893711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:44.908583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1115/2205] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:44 2022] PUT /identity/v3/projects/040c4a51c6e945038da0133cd1a60219/users/c9875e23a5c441d1ad522d1d37aba3db/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:44.919604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:44.919898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:44.920182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:44.944787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:44.948152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] MFA Rules not processed for user `c9875e23a5c441d1ad522d1d37aba3db`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:44.950140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:45.018751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1091/2206] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:45.023827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.097722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd50c78-1924-4c65-8ebc-8a7b4848d6ed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.102619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.103280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.103588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.103870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.104562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.106507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.134318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1116/2207] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:45 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:45.139260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.156004 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d3c5-91fc-43fa-a9d8-4f01a6f80a4a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.230508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.231339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.231555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.231833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.232540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.234555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.262492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1092/2208] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:45 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:01:45.263857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.275633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ba316-8d2f-4042-86da-24bcb971a2e9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.280990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.281756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.282151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.282438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.283171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.284952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.297943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1117/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:45.302552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.316203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f6bb-9932-432f-8b93-030a6967cd89 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.321700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.322770 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.323054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.323332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] PATH_INFO: `/v3/projects/647c4d14ee084117bd09d9aec842f27b/users/337a9c75ee0c43069764a028777c18e2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.342727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=647c4d14ee084117bd09d9aec842f27b, user_id=337a9c75ee0c43069764a028777c18e2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.345640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.366956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1093/2210] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:45 2022] PUT /identity/v3/projects/647c4d14ee084117bd09d9aec842f27b/users/337a9c75ee0c43069764a028777c18e2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:45.371446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.385465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f57af-9afb-41ca-befe-7f256ad8d4f5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.398428 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:45.470776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.471649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.472042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.472397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.473289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.475062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721d446-112e-40a0-80a2-7e8f0d075891 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.487495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1118/2211] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:45.491899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.504665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36734-7084-4bd6-b459-5303279f76fb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.513174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.513174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.513174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.513174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] PATH_INFO: `/v3/projects/647c4d14ee084117bd09d9aec842f27b/users/337a9c75ee0c43069764a028777c18e2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.515063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=647c4d14ee084117bd09d9aec842f27b, user_id=337a9c75ee0c43069764a028777c18e2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.523798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.544053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1094/2212] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:45 2022] PUT /identity/v3/projects/647c4d14ee084117bd09d9aec842f27b/users/337a9c75ee0c43069764a028777c18e2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:45.546652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.546952 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.547232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.584913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] MFA Rules not processed for user `337a9c75ee0c43069764a028777c18e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:45.586519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:45.661481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1119/2213] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:45.672565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:45.674451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:45.738447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218da5b-a93d-4c50-837d-d85b7118277a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:45.742150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:45.742803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:45.743087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:45.743368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:45.752168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:45.804655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:45.806090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d124e0-c784-4a09-bd30-c102e07d7806 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:45.816972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1095/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:46.234726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:46.236232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:46.300984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f2d4-a48d-4e6d-a4ec-b7007377f3ed None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:46.306154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:46.307133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:46.307420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:46.307692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] PATH_INFO: `/v3/users/1e14d05c00d04446a9772f57da7fe7f5` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:46.310342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e14d05c00d04446a9772f57da7fe7f5)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:46.312672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:46.351447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:46.360357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e14d05c00d04446a9772f57da7fe7f5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.360969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e14d05c00d04446a9772f57da7fe7f5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.361573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e14d05c00d04446a9772f57da7fe7f5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.373564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e14d05c00d04446a9772f57da7fe7f5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.380810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e14d05c00d04446a9772f57da7fe7f5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.393548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1120/2215] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:46 2022] DELETE /identity/v3/users/1e14d05c00d04446a9772f57da7fe7f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:46.398198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:46.398559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:46.398839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:46.419664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:46.421450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:46.484910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1096/2216] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:46.494932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:46.496362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:46.559629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c168-e788-49ef-874e-b0417cfbd253 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:46.563941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:46.564592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:46.564875 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:46.565151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:46.574694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:46.576186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:46.587658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1121/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:46.896231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:46.897803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:46.912507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a1e7-5754-4824-bb59-84bf607922a2 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:46.917761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:46.918709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:46.918993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:46.919274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] PATH_INFO: `/v3/projects/0c5d8417d32349e7a1bebbdec848735d` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:46.920542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5d8417d32349e7a1bebbdec848735d)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:46.923140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:46.971100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5d8417d32349e7a1bebbdec848735d', 'request_id': 'req-5e371629-22d6-4ab8-8e95-cabb8383b7dd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.977417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5d8417d32349e7a1bebbdec848735d', 'request_id': 'req-5e371629-22d6-4ab8-8e95-cabb8383b7dd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.984726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5d8417d32349e7a1bebbdec848735d', 'request_id': 'req-5e371629-22d6-4ab8-8e95-cabb8383b7dd'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.995616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] The token cache is being invalidate because project 0c5d8417d32349e7a1bebbdec848735d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:46.995844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.996530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:46.998058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1097/2218] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:46 2022] DELETE /identity/v3/projects/0c5d8417d32349e7a1bebbdec848735d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:47.002048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:47.011760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6adaa-df29-4aec-b1a4-629d22f37ef9 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:47.068931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:47.069803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:47.070087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:47.070397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] PATH_INFO: `/v3/users/02cdbf852722436bad3fc831d27d205b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:47.071595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cdbf852722436bad3fc831d27d205b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:47.073532 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:47.126595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cdbf852722436bad3fc831d27d205b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.127297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cdbf852722436bad3fc831d27d205b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.128004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cdbf852722436bad3fc831d27d205b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.136999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:47.146059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cdbf852722436bad3fc831d27d205b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.158081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cdbf852722436bad3fc831d27d205b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.189297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1122/2219] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:47 2022] DELETE /identity/v3/users/02cdbf852722436bad3fc831d27d205b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:47.514765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:47.516347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:47.532366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e371629-22d6-4ab8-8e95-cabb8383b7dd admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:47.575236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:47.609860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:47.611121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:47.611505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:47.611810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] PATH_INFO: `/v3/projects/0841ab6a7dca4965a05a957651367a64` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:47.613965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0841ab6a7dca4965a05a957651367a64)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:47.616155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:47.669949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0841ab6a7dca4965a05a957651367a64', 'request_id': 'req-216b31b5-074c-4c61-a0d5-5d5efc59bee4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.678403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0841ab6a7dca4965a05a957651367a64', 'request_id': 'req-216b31b5-074c-4c61-a0d5-5d5efc59bee4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.687413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0841ab6a7dca4965a05a957651367a64', 'request_id': 'req-216b31b5-074c-4c61-a0d5-5d5efc59bee4'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.705521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] The token cache is being invalidate because project 0841ab6a7dca4965a05a957651367a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:47.705816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.706552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-216b31b5-074c-4c61-a0d5-5d5efc59bee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:47.722152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1098/2220] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:47 2022] DELETE /identity/v3/projects/0841ab6a7dca4965a05a957651367a64 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:48.389804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:48.391583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:48.406042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67264302-b6d3-4580-9bdb-95e2647b6551 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:48.471521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:48.472494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:48.472868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:48.473380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] PATH_INFO: `/v3/users/c9875e23a5c441d1ad522d1d37aba3db` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:48.474605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9875e23a5c441d1ad522d1d37aba3db)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:48.476584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:48.533869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9875e23a5c441d1ad522d1d37aba3db'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:48.533869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9875e23a5c441d1ad522d1d37aba3db'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:48.534566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9875e23a5c441d1ad522d1d37aba3db'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:48.551416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9875e23a5c441d1ad522d1d37aba3db'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:48.559297 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9875e23a5c441d1ad522d1d37aba3db'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:48.571865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1123/2221] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:48 2022] DELETE /identity/v3/users/c9875e23a5c441d1ad522d1d37aba3db => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:48.577487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:48.578488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:48.578774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:48.597803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:48.599053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:48.659544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1099/2222] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:48.669312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:48.670815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:48.729814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7ec2a-cbd3-48b7-9301-1235f8fa9db7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:48.734402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:48.735056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:48.735430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:48.735710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:48.745513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:48.746976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:48.751179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:48.758623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1124/2223] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:49.156541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:49.157982 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:49.169933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fabc-3563-4bfc-bf11-c0b4bd106247 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:49.175018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:49.175893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:49.176179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:49.176458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] PATH_INFO: `/v3/projects/040c4a51c6e945038da0133cd1a60219` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:49.177692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040c4a51c6e945038da0133cd1a60219)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:49.179656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:49.230946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040c4a51c6e945038da0133cd1a60219', 'request_id': 'req-ccb95bf4-72b3-41ad-9cd8-78028d027608'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.238364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040c4a51c6e945038da0133cd1a60219', 'request_id': 'req-ccb95bf4-72b3-41ad-9cd8-78028d027608'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.241942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:49.245843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040c4a51c6e945038da0133cd1a60219', 'request_id': 'req-ccb95bf4-72b3-41ad-9cd8-78028d027608'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.258557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] The token cache is being invalidate because project 040c4a51c6e945038da0133cd1a60219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:49.258848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.259469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.260996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1100/2224] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:49 2022] DELETE /identity/v3/projects/040c4a51c6e945038da0133cd1a60219 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:01:49.264906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:49.274425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0beb-4eaa-4e7b-bce1-951a59855610 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:49.330216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:49.331004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:49.331281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:49.331552 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] PATH_INFO: `/v3/users/337a9c75ee0c43069764a028777c18e2` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:49.332720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=337a9c75ee0c43069764a028777c18e2)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:49.334663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:49.380035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337a9c75ee0c43069764a028777c18e2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.380684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337a9c75ee0c43069764a028777c18e2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.381293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337a9c75ee0c43069764a028777c18e2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.393180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337a9c75ee0c43069764a028777c18e2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.400204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2acfa5b1-dd87-4a18-8904-e015441ee82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337a9c75ee0c43069764a028777c18e2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.413181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1125/2225] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:49 2022] DELETE /identity/v3/users/337a9c75ee0c43069764a028777c18e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:49.716720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:49.719454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:49.747808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb95bf4-72b3-41ad-9cd8-78028d027608 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:49.813840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:49.814929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:49.815364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:49.815787 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] PATH_INFO: `/v3/projects/647c4d14ee084117bd09d9aec842f27b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:49.817445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647c4d14ee084117bd09d9aec842f27b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:49.819655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:49.880511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647c4d14ee084117bd09d9aec842f27b', 'request_id': 'req-f6cec292-5e09-47f4-813b-766528322df1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.887404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647c4d14ee084117bd09d9aec842f27b', 'request_id': 'req-f6cec292-5e09-47f4-813b-766528322df1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.898012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647c4d14ee084117bd09d9aec842f27b', 'request_id': 'req-f6cec292-5e09-47f4-813b-766528322df1'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.912536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] The token cache is being invalidate because project 647c4d14ee084117bd09d9aec842f27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:49.912943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.913732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f6cec292-5e09-47f4-813b-766528322df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:49.915618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1101/2226] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:49 2022] DELETE /identity/v3/projects/647c4d14ee084117bd09d9aec842f27b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:49.923782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:49.924195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:49.924574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:49.958006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:49.959331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:50.020170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1126/2227] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:50.028964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.029321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.030962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.048672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:50.049892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:50.057874 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1102/2228] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:50.062378 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.072038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c227-1bef-4ed2-ac76-6103fa50743b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.076755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.078286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.078467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.078759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.079420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:50.079728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.081429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.084002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:50.097701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1127/2229] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:50.101611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.111901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6858b29-073b-4676-9b2b-6f9adb40bc19 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.117467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.117821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.118277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.118566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.119481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.121194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.149023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1103/2230] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:50 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:50.161054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.179158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486b19-cf80-4a26-a8cf-6677113aa170 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.243845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.244528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.244811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.245089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.245789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.247770 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.273045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1128/2231] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:50 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:50.274563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.285736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63219511-92d3-435d-a38e-7daff49e229f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.291296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.291750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.292084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.292367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.293100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.294903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.310875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1104/2232] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:50.313048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.323434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bf08d-0abf-43f7-9fef-0517931bb254 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.328687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.329347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.329650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.329908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.330703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.332308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b856ed-4a1d-4672-ae7c-7d964d1c2e17 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.343602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1129/2233] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:50.348011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.357912 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330604-2fc7-43e5-b109-89518c6aadfd admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.363217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.364102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.364381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.364769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] PATH_INFO: `/v3/projects/1c13c703e04047e389d765c0b35dc85e/users/1de24b52ca824bf4b09d7cf54d483465/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.383932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c13c703e04047e389d765c0b35dc85e, user_id=1de24b52ca824bf4b09d7cf54d483465, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.386777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.402718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1105/2234] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:50 2022] PUT /identity/v3/projects/1c13c703e04047e389d765c0b35dc85e/users/1de24b52ca824bf4b09d7cf54d483465/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:50.413905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe07aea-14cc-407d-9328-c3329fe302c7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.414348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe07aea-14cc-407d-9328-c3329fe302c7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.415214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe07aea-14cc-407d-9328-c3329fe302c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.433756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1fe07aea-14cc-407d-9328-c3329fe302c7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:50.435000 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1fe07aea-14cc-407d-9328-c3329fe302c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:50.510542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1130/2235] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:50.522188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:50.523959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:50.540894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:50.585910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0419b-1a54-49cd-8fb3-9ecc838158c7 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:50.589668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:50.590347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:50.590634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:50.590911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:50.603018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:50.604396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:50.615984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1106/2236] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:51.708580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50bd3-84b3-49ed-aa00-8298bface554 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:51.709066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50bd3-84b3-49ed-aa00-8298bface554 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:51.709187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50bd3-84b3-49ed-aa00-8298bface554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:51.742343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-78c50bd3-84b3-49ed-aa00-8298bface554 None None] MFA Rules not processed for user `1de24b52ca824bf4b09d7cf54d483465`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:51.747718 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-78c50bd3-84b3-49ed-aa00-8298bface554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:51.883674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1131/2237] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:51.896451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:51.898891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:51.965965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ded6c-08ef-435e-89e3-182bb8e12887 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:51.970671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:51.971449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:51.971833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:51.972864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:51.981974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:51.984258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:52.002414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1107/2238] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:53.514044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e391ac8-3a3e-4114-b81e-37c8e4ff9c36 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:53.514596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e391ac8-3a3e-4114-b81e-37c8e4ff9c36 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:53.515107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e391ac8-3a3e-4114-b81e-37c8e4ff9c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:53.521653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:53.533546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7e391ac8-3a3e-4114-b81e-37c8e4ff9c36 None None] MFA Rules not processed for user `1de24b52ca824bf4b09d7cf54d483465`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:53.534772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7e391ac8-3a3e-4114-b81e-37c8e4ff9c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:53.541571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1132/2239] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:57.657840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:57.660508 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:57.682227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc89d-93c6-4e78-8c83-858c3ce018d6 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:57.688430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:57.689602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:57.690182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:57.690927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] PATH_INFO: `/v3/users/a1f1975ba03f45c8a7a409e0ee86da30` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:57.692404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f1975ba03f45c8a7a409e0ee86da30)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:57.694416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:57.763690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f1975ba03f45c8a7a409e0ee86da30'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:57.775989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f1975ba03f45c8a7a409e0ee86da30'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:57.784771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f1975ba03f45c8a7a409e0ee86da30'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:57.804834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f1975ba03f45c8a7a409e0ee86da30'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:57.806039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f1975ba03f45c8a7a409e0ee86da30'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:57.819542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1108/2240] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:57 2022] DELETE /identity/v3/users/a1f1975ba03f45c8a7a409e0ee86da30 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:57.824034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:57.824543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:57.824543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:57.849275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:57.850733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:57.950772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1133/2241] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:01:57.962495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:57.972095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:58.026738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:58.073861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b8aa2-7ccd-40ce-bef7-cef3f8e135dc admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.078580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.079203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.079489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.079769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.101440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.103088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c634e7-3ec2-46a1-b6d7-454e91dbf6b0 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.117355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1109/2242] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:58.414329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.415839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:58.429945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7967a1-d1e5-458d-a44f-1e1fc7950d70 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.443854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.444818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.445175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.445536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] PATH_INFO: `/v3/projects/54d978fe542245cdba7d0caa67e72f8f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.446890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d978fe542245cdba7d0caa67e72f8f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.449265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.502678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d978fe542245cdba7d0caa67e72f8f', 'request_id': 'req-f81e3695-5b46-4347-af5b-625cec06a9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:58.508594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d978fe542245cdba7d0caa67e72f8f', 'request_id': 'req-f81e3695-5b46-4347-af5b-625cec06a9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:58.516488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d978fe542245cdba7d0caa67e72f8f', 'request_id': 'req-f81e3695-5b46-4347-af5b-625cec06a9e5'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:58.528747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] The token cache is being invalidate because project 54d978fe542245cdba7d0caa67e72f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:01:58.529031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:58.529725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f81e3695-5b46-4347-af5b-625cec06a9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:01:58.531648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1134/2243] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:01:58 2022] DELETE /identity/v3/projects/54d978fe542245cdba7d0caa67e72f8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:58.536298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.536587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.536861 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.555509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:58.556703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:58.632583 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1110/2244] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:58.641083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.641373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.641651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.661373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:58.662608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:58.671292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1135/2245] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:58.676093 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.686588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e90f1d-0565-47a3-af18-892125791aaf None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.691225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.691897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.692181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.692458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.693190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:01:58.693499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.695132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.711979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1111/2246] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:01:58.713306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.724330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db183-0bb5-454e-b6e0-d4619e1aa1e7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.729087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.729747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.730031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.730347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.731161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.733735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.763921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1136/2247] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:01:58 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:58.766450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.777137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108db2ee-2a7e-4f8f-9b98-aaf84270b4ea admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.843325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.843923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.844480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.844757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.845462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.847400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.875268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1112/2248] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:01:58 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:01:58.876626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.887747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78c02a-2b29-4bd4-92dc-9c5744798e0f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.893546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.894247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.894528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.894805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.895529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.897124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.909306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1137/2249] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:58.913341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.923987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0d-be83-482f-adf1-089332e0ab49 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.928634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.929286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.929563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.929835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.930587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.932164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b937bc-3bb6-4180-9482-62dbf1e947d6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:58.943444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1113/2250] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:01:58.948009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:58.965817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca2bb-fefe-4b02-8815-5c64fc267fed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:58.974129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:58.975676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:58.976263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:58.976796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] PATH_INFO: `/v3/projects/73016ef4220c42499fe305551904ab34/users/84d112a3cf154c35992f075314499f59/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:58.995022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73016ef4220c42499fe305551904ab34, user_id=84d112a3cf154c35992f075314499f59, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:58.997841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:59.014784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1138/2251] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:01:58 2022] PUT /identity/v3/projects/73016ef4220c42499fe305551904ab34/users/84d112a3cf154c35992f075314499f59/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:01:59.024665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:59.024953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:59.025231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:59.054581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] MFA Rules not processed for user `84d112a3cf154c35992f075314499f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:01:59.055777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:59.087960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:59.133596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1114/2252] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:01:59.147075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:59.150043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:01:59.172457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:01:59.213173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55f94-dba8-48ed-a365-0e576822c661 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:01:59.217433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:01:59.218278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:01:59.218576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:01:59.218853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:01:59.228371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:01:59.229909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc1b9c-6b14-4fb7-bd90-ddcb57b08a83 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:01:59.240923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1139/2253] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:01:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:01:59.931104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:01:59.932552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:00.000376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53988b-c0ba-4a5c-89a8-8fd989025243 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:00.005044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:00.005909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:00.006221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:00.006492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] PATH_INFO: `/v3/users/7f2fcd2c5c494f20b6c370ea9553e8c2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:00.007664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2fcd2c5c494f20b6c370ea9553e8c2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:00.009630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:00.057082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2fcd2c5c494f20b6c370ea9553e8c2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.071110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2fcd2c5c494f20b6c370ea9553e8c2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.079029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2fcd2c5c494f20b6c370ea9553e8c2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.085948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2fcd2c5c494f20b6c370ea9553e8c2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.086598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2fcd2c5c494f20b6c370ea9553e8c2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.094039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1115/2254] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:01:59 2022] DELETE /identity/v3/users/7f2fcd2c5c494f20b6c370ea9553e8c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:02:00.098615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:00.099069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:00.099227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:00.117811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:00.119101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:00.185249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1140/2255] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:00.196012 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:00.197414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:00.256451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:00.260628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914671-f111-405e-88e1-ff12f144fe0b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:00.267573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:00.268347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:00.268723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:00.269206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:00.278814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:00.280543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:00.290156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1116/2256] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:00.578831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:00.580269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:00.593023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f7e7f-7541-4861-9099-56bec34edecb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:00.598156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:00.599033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:00.599312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:00.599584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] PATH_INFO: `/v3/projects/e19b82390f674beeb1724b2b126095b0` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:00.601142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19b82390f674beeb1724b2b126095b0)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:00.603109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:00.654324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19b82390f674beeb1724b2b126095b0', 'request_id': 'req-6d059846-60b9-4f78-909c-5578bbfcdf9f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.662026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19b82390f674beeb1724b2b126095b0', 'request_id': 'req-6d059846-60b9-4f78-909c-5578bbfcdf9f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.672434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19b82390f674beeb1724b2b126095b0', 'request_id': 'req-6d059846-60b9-4f78-909c-5578bbfcdf9f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.685863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] The token cache is being invalidate because project e19b82390f674beeb1724b2b126095b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:02:00.686172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.686994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6d059846-60b9-4f78-909c-5578bbfcdf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:00.689604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1141/2257] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:02:00 2022] DELETE /identity/v3/projects/e19b82390f674beeb1724b2b126095b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:02:04.357504 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:04.359460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:04.374595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a194-4ba3-43a7-a7b6-6a2fbe7dee2f service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:04.463754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:04.464620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:04.464900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:04.465171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] PATH_INFO: `/v3/users/84d112a3cf154c35992f075314499f59` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:04.466415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d112a3cf154c35992f075314499f59)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:04.468947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:04.520639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d112a3cf154c35992f075314499f59'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:04.533353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d112a3cf154c35992f075314499f59'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:04.541461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d112a3cf154c35992f075314499f59'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:04.549313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d112a3cf154c35992f075314499f59'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:04.549968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d112a3cf154c35992f075314499f59'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:04.556498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1117/2258] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:02:04 2022] DELETE /identity/v3/users/84d112a3cf154c35992f075314499f59 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:02:04.565238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:04.565693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:04.565803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:04.583440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:04.584641 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:04.627319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:04.647851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1142/2259] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:04.657913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:04.659351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:04.717896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1564daf-b2c4-4786-9133-586f4310181d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:04.721322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:04.721972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:04.722292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:04.722570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:04.731427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:04.733511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8c526-bde8-4cbe-a752-ef40014fb501 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:04.743673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1118/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:05.055131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.056881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:05.072704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e333541-117a-4df4-a86b-2d33a4b0922c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.079659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.080551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.080840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.081122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] PATH_INFO: `/v3/projects/73016ef4220c42499fe305551904ab34` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.082423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=73016ef4220c42499fe305551904ab34)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.084832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.143846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73016ef4220c42499fe305551904ab34', 'request_id': 'req-1c432e96-ced4-402e-8d31-47ff6d34cfcc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:05.149433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73016ef4220c42499fe305551904ab34', 'request_id': 'req-1c432e96-ced4-402e-8d31-47ff6d34cfcc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:05.157986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73016ef4220c42499fe305551904ab34', 'request_id': 'req-1c432e96-ced4-402e-8d31-47ff6d34cfcc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:05.171274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] The token cache is being invalidate because project 73016ef4220c42499fe305551904ab34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:02:05.171570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:05.172249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1c432e96-ced4-402e-8d31-47ff6d34cfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:02:05.173810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1143/2261] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:02:05 2022] DELETE /identity/v3/projects/73016ef4220c42499fe305551904ab34 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:02:05.178858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.179264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.179616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.210611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:05.212001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:05.223994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:05.302161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1119/2262] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:05.312884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.313286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.313706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.334037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:05.335635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:05.345102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1144/2263] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:05.349858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.361521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac12be-81ac-4e41-b181-bb05af5bb363 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.367724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.368399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.368683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.368961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.369693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:02:05.369997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.372210 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.385443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1120/2264] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:02:05.389820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.399724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6178ea-016b-4f87-adc7-f771e46a18eb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.411272 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.412136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.412415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.412689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.413512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.421200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.449198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1145/2265] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:02:05 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:02:05.453521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.463486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc459a-8562-4d3a-8993-68410cfdfc6b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.524103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.524778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.525067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.525347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.526033 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.527973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.549154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1121/2266] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:02:05 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:02:05.553317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.564174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e818a5-8e09-4460-abf8-067d27c27d54 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.569259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.569806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.570092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.570405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.571139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.572774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.584808 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1146/2267] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:02:05.589080 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.599785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979ca6-a314-4fc9-a569-27b3a193a391 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.605476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.606180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.606600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.606886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.607722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.609331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976994b-36e5-479f-a529-93366ecf7686 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.622167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1122/2268] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:02:05.627640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.639484 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4ea7-a2bc-424a-8577-a89824f61db4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.644686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.645589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.645881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.646190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] PATH_INFO: `/v3/projects/0494821f2c9544dca6b26eb37178a82b/users/15872c8688cd42ebbc0eab8bf7f0d064/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.662178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0494821f2c9544dca6b26eb37178a82b, user_id=15872c8688cd42ebbc0eab8bf7f0d064, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.664795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.687968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1147/2269] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:02:05 2022] PUT /identity/v3/projects/0494821f2c9544dca6b26eb37178a82b/users/15872c8688cd42ebbc0eab8bf7f0d064/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:02:05.689229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7c04-f073-4c52-a575-1a4a39aa192e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.689523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7c04-f073-4c52-a575-1a4a39aa192e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.689805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7c04-f073-4c52-a575-1a4a39aa192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.709596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b2ba7c04-f073-4c52-a575-1a4a39aa192e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:05.710852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b2ba7c04-f073-4c52-a575-1a4a39aa192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:05.797951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1123/2270] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:05.808189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:05.809970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:05.881977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d70a0-eb58-43fa-ad4e-fdb4be03cb31 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:05.885792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:05.886467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:05.886748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:05.887021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:05.897835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:05.899332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:05.911457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1148/2271] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:09.367902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448dba-7e70-4c3a-8ed9-6bf56c91214a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:09.368887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448dba-7e70-4c3a-8ed9-6bf56c91214a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:09.369166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43448dba-7e70-4c3a-8ed9-6bf56c91214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:09.434525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-43448dba-7e70-4c3a-8ed9-6bf56c91214a None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:09.437067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-43448dba-7e70-4c3a-8ed9-6bf56c91214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:09.443429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:09.533138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1124/2272] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:09.584224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:09.587443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:09.599659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:09.687505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc21cf0-175a-46b7-a267-5f6fcc75b2aa service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:09.694659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:09.695417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:09.695802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:09.696147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:09.705711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:09.707519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335a990-4e15-4006-95d0-05b3e815721c service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:09.719675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1149/2273] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:02:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:02:11.487338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:11.487805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:11.487917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:11.522588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] MFA Rules not processed for user `1de24b52ca824bf4b09d7cf54d483465`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:11.524168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:11.660621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1125/2274] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:12.319788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:12.320333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:12.320333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:12.362773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] MFA Rules not processed for user `15872c8688cd42ebbc0eab8bf7f0d064`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:12.364178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:12.552719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1150/2275] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:12.557300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:12.577096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9edf5d-db19-409f-b135-f13e70aac9ec None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:12.596686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:12.597375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:12.597654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:12.598130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:12.599001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:12.601092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:12.665960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1126/2276] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:02:12 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:02:12.667611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:12.690401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292eb0-79d2-4218-af0b-528c4f20690f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:12.777650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:12.778307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:12.778624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:12.779691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:12.780578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:12.782903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:12.809279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1151/2277] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:02:12 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:02:12.813662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:12.832913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb09a77-c29f-4695-b60a-8e130ec3ce8d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:12.842387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:12.843315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:12.843615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:12.843951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:12.844806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:12.846598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:12.858992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1127/2278] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:02:12.863633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:12.876503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641f149-2095-4074-a5eb-1712d5c10f45 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:12.883090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:12.884167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:12.884452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:12.884733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] PATH_INFO: `/v3/projects/1d00de35c17e49bda8ecace9d97553b6/users/499719d75fde4388a7fcb2bdb27b216e/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:12.902674 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:12.906404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d00de35c17e49bda8ecace9d97553b6, user_id=499719d75fde4388a7fcb2bdb27b216e, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:12.909238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:12.934481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1152/2279] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:02:12 2022] PUT /identity/v3/projects/1d00de35c17e49bda8ecace9d97553b6/users/499719d75fde4388a7fcb2bdb27b216e/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:02:12.939445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:12.956704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5cf6-aad6-4c98-9fcf-f088af1733bf admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:13.062806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:13.063438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:13.063719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:13.064376 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:13.064957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:13.066719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2afb56-1097-4414-9d1c-7aea50921069 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:13.080853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1128/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:02:13.085468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:13.106827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b27b-b7f1-408a-b824-42cae77321c5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:13.136911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:13.137994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:13.139167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:13.140188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] PATH_INFO: `/v3/projects/1d00de35c17e49bda8ecace9d97553b6/users/499719d75fde4388a7fcb2bdb27b216e/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:13.145156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d00de35c17e49bda8ecace9d97553b6, user_id=499719d75fde4388a7fcb2bdb27b216e, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:13.148849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:13.281135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1153/2281] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:02:13 2022] PUT /identity/v3/projects/1d00de35c17e49bda8ecace9d97553b6/users/499719d75fde4388a7fcb2bdb27b216e/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:02:20.757139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb17d46-4ab2-40ad-b7ae-0190c16e8ddf None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:20.758063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb17d46-4ab2-40ad-b7ae-0190c16e8ddf None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:20.758560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb17d46-4ab2-40ad-b7ae-0190c16e8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:20.803319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-beb17d46-4ab2-40ad-b7ae-0190c16e8ddf None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:20.804777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-beb17d46-4ab2-40ad-b7ae-0190c16e8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:20.836866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:21.114926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1129/2282] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:02:21.911519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:21.914450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:22.151412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ce37c-523e-4029-9f71-5b1e640c0c6d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:22.171326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:22.173677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:22.174014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:22.174326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:22.198911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:22.202559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:22.230772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1154/2283] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:23.772562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec54fa-8a48-42cd-8e53-58ab794963fc None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:23.773897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec54fa-8a48-42cd-8e53-58ab794963fc None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:23.775266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec54fa-8a48-42cd-8e53-58ab794963fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:23.874760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-77ec54fa-8a48-42cd-8e53-58ab794963fc None None] MFA Rules not processed for user `499719d75fde4388a7fcb2bdb27b216e`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:23.881420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-77ec54fa-8a48-42cd-8e53-58ab794963fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:24.054937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:24.057073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:24.062839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1130/2284] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:24.282672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb7a7-e32f-4127-8093-65adc099e908 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:24.287789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:24.288323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:24.288608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:24.288886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:24.354660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:24.411976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:24.416056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:24.480638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1155/2285] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:02:24.690350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289fe26-a85b-4ec5-b1b0-c986956daaa1 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:24.690831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289fe26-a85b-4ec5-b1b0-c986956daaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:24.691189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289fe26-a85b-4ec5-b1b0-c986956daaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:24.771133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e289fe26-a85b-4ec5-b1b0-c986956daaa1 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:24.772422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e289fe26-a85b-4ec5-b1b0-c986956daaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:24.897991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1131/2286] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:24.917511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:25.115870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36059a3a-f676-4a33-90a8-d75397ea1233 service glance] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:25.130554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:25.131225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:25.131520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:25.131793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:25.158909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:25.161147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:25.181385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1156/2287] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:02:27.502422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409bbf4-0439-4de7-a330-b8f86ae638dd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:27.502873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409bbf4-0439-4de7-a330-b8f86ae638dd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:27.503114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409bbf4-0439-4de7-a330-b8f86ae638dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:27.550288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c409bbf4-0439-4de7-a330-b8f86ae638dd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:27.561071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c409bbf4-0439-4de7-a330-b8f86ae638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:27.594072 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1132/2288] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:27.606252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:27.610791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:27.636699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8938713-71f0-4e63-8f4b-5c4b72e1dfd9 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:27.648701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:27.650991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:27.653031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:27.654326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:27.679742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:27.686772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2179-60e5-48e0-a013-072e2165fa38 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:27.702960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1157/2289] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:29.969174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:29.969700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:29.969809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:30.008577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] MFA Rules not processed for user `80d7626dce354de8af8ce1894665c477`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:30.010199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:30.016455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:30.117109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1133/2290] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:31.985376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee721-e7ce-4598-bf37-ddadede33618 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:31.985862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee721-e7ce-4598-bf37-ddadede33618 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:31.985958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee721-e7ce-4598-bf37-ddadede33618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:32.037946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-aa3ee721-e7ce-4598-bf37-ddadede33618 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:32.039247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-aa3ee721-e7ce-4598-bf37-ddadede33618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:32.054645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1158/2291] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:32.153835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:32.171534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984eed6-ab81-48e0-95c7-558b08881655 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:32.178523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:32.179706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:32.180208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:32.180715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:32.192808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:32.194746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:32.211715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1134/2292] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:36.063852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b942-8535-41e6-8eb4-9d3e67d28d4e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.063852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b942-8535-41e6-8eb4-9d3e67d28d4e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.063852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b942-8535-41e6-8eb4-9d3e67d28d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.085578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-47e1b942-8535-41e6-8eb4-9d3e67d28d4e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:36.089489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-47e1b942-8535-41e6-8eb4-9d3e67d28d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:36.101071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1159/2293] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:36.140710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:36.152523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275ad1-84b6-4514-84b8-f8675cb0efe6 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:36.170561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:36.172053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.172771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.173104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.183803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:36.186052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ca95e-e8df-43f8-933c-9b9f0c3dd080 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:36.203223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1135/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:36.637178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.637961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.638954 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.640392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1160/2295] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:02:36.647775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4f3-473d-4b5a-afc8-fec17e4e8af4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.648307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4f3-473d-4b5a-afc8-fec17e4e8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.648582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4f3-473d-4b5a-afc8-fec17e4e8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.719537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-80a7c4f3-473d-4b5a-afc8-fec17e4e8af4 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:36.721436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-80a7c4f3-473d-4b5a-afc8-fec17e4e8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:36.751730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1136/2296] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:36.752633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:36.754871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:36.773860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863a83-7216-440c-990f-5a5fb801c836 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:36.778443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:36.779258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.779651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.780027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.796263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:36.809983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0526ec-a8ba-4ad7-81eb-9c6a2c1fdce0 service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:36.845147 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1161/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:36.944450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.944964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.945318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.947183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1137/2298] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:02:36.955111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa317-455e-425d-b401-bc0273a3e8e5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:36.955410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa317-455e-425d-b401-bc0273a3e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:36.955691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa317-455e-425d-b401-bc0273a3e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:36.977393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b66aa317-455e-425d-b401-bc0273a3e8e5 None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:36.978673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b66aa317-455e-425d-b401-bc0273a3e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:37.044184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1162/2299] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:37.054909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:37.056921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:37.073697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82226fa-871a-44b0-a986-e1f257766361 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:37.081545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:37.082324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:37.082619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:37.082898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:37.091285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:37.092822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ac5d-76a6-4947-9782-327e1cea4e32 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:37.105496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1138/2300] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:37.233960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2777-98e2-4196-9828-3c748daf9aca None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:37.234570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2777-98e2-4196-9828-3c748daf9aca None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:37.234680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2777-98e2-4196-9828-3c748daf9aca None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:37.236500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1163/2301] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 13:02:37.243115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783496a-34cd-43fa-a5d6-e57490868bb5 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:37.244834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783496a-34cd-43fa-a5d6-e57490868bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:37.247716 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783496a-34cd-43fa-a5d6-e57490868bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:37.281062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b783496a-34cd-43fa-a5d6-e57490868bb5 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:37.286609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b783496a-34cd-43fa-a5d6-e57490868bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:37.318457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1139/2302] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:37.328487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2777-98e2-4196-9828-3c748daf9aca None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:37.341362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2777-98e2-4196-9828-3c748daf9aca None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:37.345402 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:37.346097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:37.346417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:37.346696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:37.373744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:37.375604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197fb53-b052-45eb-ae79-d9f21d11e2df service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:37.398442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1164/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:38.311877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:38.313231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:38.313602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:38.334143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] MFA Rules not processed for user `15872c8688cd42ebbc0eab8bf7f0d064`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:38.335465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:38.344420 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1140/2304] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:40.343927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc04-90fd-4ace-bc2c-16c517b4eed2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:40.346024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc04-90fd-4ace-bc2c-16c517b4eed2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:40.346024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebcc04-90fd-4ace-bc2c-16c517b4eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:40.379490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f5ebcc04-90fd-4ace-bc2c-16c517b4eed2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:40.381882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f5ebcc04-90fd-4ace-bc2c-16c517b4eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:40.413488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1165/2305] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:40.541538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:40.559917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e6e6-f73a-4aa1-8eab-feec515ecd1d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:40.565451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:40.566396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:40.566681 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:40.566958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:40.576183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:40.577776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:40.588212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1141/2306] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:42.726188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e4e-a191-4335-9a00-9b8608927d47 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:42.726616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e4e-a191-4335-9a00-9b8608927d47 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:42.726897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c500e4e-a191-4335-9a00-9b8608927d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:42.747286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0c500e4e-a191-4335-9a00-9b8608927d47 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:42.748511 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0c500e4e-a191-4335-9a00-9b8608927d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:42.757044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1166/2307] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:42.769937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:42.782098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000617b1-e6f9-441f-ab9f-6abfb8c2c709 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:42.787601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:42.788332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:42.788806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:42.789147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:42.800449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:42.802123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:42.810810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1142/2308] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:02:44.544123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb76d-644d-4d7f-9d2b-3c613ff9b2b5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:44.544903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb76d-644d-4d7f-9d2b-3c613ff9b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:44.544903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fb76d-644d-4d7f-9d2b-3c613ff9b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:44.551248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:44.565824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-543fb76d-644d-4d7f-9d2b-3c613ff9b2b5 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:44.567077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-543fb76d-644d-4d7f-9d2b-3c613ff9b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:44.576103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1167/2309] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:44.595701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:44.607858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97383-c0e1-400f-beac-e4fe22e4be45 service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:44.613509 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:44.614185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:44.614472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:44.614744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:44.624798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:44.626547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4ad87-8bba-4555-b0c9-931dfbc9ee84 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:44.639489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1143/2310] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:02:54.559651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:54.632854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=72 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:02:56.188892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:56.190066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:56.191032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:56.211750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:56.213038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:56.218206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e95d-f649-4572-a260-311e36171286 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:56.218765 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e95d-f649-4572-a260-311e36171286 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:56.219011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e95d-f649-4572-a260-311e36171286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:56.224476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1168/2311] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:56.239368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:56.241570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-af10e95d-f649-4572-a260-311e36171286 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:02:56.242839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-af10e95d-f649-4572-a260-311e36171286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:02:56.252854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1144/2312] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:02:56.255427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ca08b-ba42-46a6-81fb-d22b2d0b3f71 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:56.272277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10e95d-f649-4572-a260-311e36171286 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:02:56.273506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:56.277843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:56.278310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:56.278688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:56.288760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:56.290163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10e95d-f649-4572-a260-311e36171286 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:02:56.291415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1806-7027-4796-ab3e-633cee271417 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:56.297481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:02:56.298259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:02:56.298538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:02:56.298998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:02:56.307860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1169/2313] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:02:56.312684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:02:56.314635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:02:56.330992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1145/2314] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:03:06.298713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=9 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:06.326560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=9 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:15.313359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:15.314006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:15.314006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:15.337795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:15.339144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:15.347336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1170/2315] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:15.377476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:15.395593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7331af6-9de2-432d-b9f1-218c81d2ac8d service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:15.408171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:15.409306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:15.409767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:15.412758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:15.435123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:15.437317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:15.449860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1146/2316] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:03:17.065623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:17.067110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:17.159279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc84a62-0b45-4507-a543-6e27880173a6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:17.165781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:17.166518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:17.166804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:17.167686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:17.169557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:17.181967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:17.183843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:17.194590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1171/2317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:17.790987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:17.792618 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:17.809895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedadfe-82f4-437b-8144-bf7d12f1cbfc service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:17.814671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:17.815570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:17.815829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:17.816107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] PATH_INFO: `/v3/users/1de24b52ca824bf4b09d7cf54d483465` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:17.817301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de24b52ca824bf4b09d7cf54d483465)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:17.819251 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:17.937731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de24b52ca824bf4b09d7cf54d483465'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:17.961097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de24b52ca824bf4b09d7cf54d483465'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:17.978839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de24b52ca824bf4b09d7cf54d483465'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.002075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de24b52ca824bf4b09d7cf54d483465'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.004330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-885c0cf8-9d93-4880-9a2c-e649c179c84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de24b52ca824bf4b09d7cf54d483465'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.013638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1147/2318] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:03:17 2022] DELETE /identity/v3/users/1de24b52ca824bf4b09d7cf54d483465 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:18.215972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.229725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2863b8-ac9a-4678-a2c2-9c92badf5bba service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.349676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.350804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.351193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.351578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] PATH_INFO: `/v3/projects/1c13c703e04047e389d765c0b35dc85e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.352968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c13c703e04047e389d765c0b35dc85e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.357384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.439520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c13c703e04047e389d765c0b35dc85e', 'request_id': 'req-01967b21-fa22-49f1-8549-bd6791a49a05'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.445643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c13c703e04047e389d765c0b35dc85e', 'request_id': 'req-01967b21-fa22-49f1-8549-bd6791a49a05'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.456421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c13c703e04047e389d765c0b35dc85e', 'request_id': 'req-01967b21-fa22-49f1-8549-bd6791a49a05'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.457992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:18.473469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] The token cache is being invalidate because project 1c13c703e04047e389d765c0b35dc85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:03:18.474218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.475554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-01967b21-fa22-49f1-8549-bd6791a49a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:18.477881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1172/2319] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:03:18 2022] DELETE /identity/v3/projects/1c13c703e04047e389d765c0b35dc85e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:03:18.485209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.485523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.486008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.511324 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:18.513290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:18.624137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1148/2320] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:18.631608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.632123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.632851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.658518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:18.659837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:18.668639 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1173/2321] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:03:18.673292 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.684690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9a3c8-fb6d-48db-befc-622a3fecf743 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.689490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.690192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.690475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.690748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.691514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:03:18.691820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.693579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.711070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1149/2322] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:03:18.712330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.723310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352b05-e749-468e-866c-e8a95ad22443 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.727915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.728581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.728917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.729216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.730349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.732288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.766712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1174/2323] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:03:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:03:18.767946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.779655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512019-9900-4894-8843-dde43fc1b301 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.827326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:18.845595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.846326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.846615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.846895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.847645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.849593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.869941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1150/2324] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:03:18 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:03:18.874253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.884362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a4a53-391c-46ad-9050-853e31f1d567 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.889695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.890384 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.890686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.891061 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.891791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.893390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.908455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1175/2325] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:03:18.909796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.920530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a28e6c-6b32-4fea-9312-f3e7e7df03f6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.925732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.926430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.926719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.926997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.927727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.929340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af3d69-1966-49d9-a419-648cebdc84c8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:18.943623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1151/2326] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:03:18.944926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:18.955844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbee7-8e74-4db4-a43a-f17bf1432ca9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:18.961081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:18.961971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:18.962294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:18.962577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] PATH_INFO: `/v3/projects/868fbab2a9a945cc84954fa1729ab375/users/0768aa9a44184e6fbb438e40f3edd075/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:18.981194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868fbab2a9a945cc84954fa1729ab375, user_id=0768aa9a44184e6fbb438e40f3edd075, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:18.984619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:19.005622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1176/2327] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:03:18 2022] PUT /identity/v3/projects/868fbab2a9a945cc84954fa1729ab375/users/0768aa9a44184e6fbb438e40f3edd075/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:19.018213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:19.018516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:19.018966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:19.050182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] MFA Rules not processed for user `0768aa9a44184e6fbb438e40f3edd075`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:19.051843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:19.124200 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1152/2328] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:19.135017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:19.137401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:19.216206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795ccfa-c6a6-4d4e-8834-d12f0877b750 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:19.219889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:19.220534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:19.220819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:19.221093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:19.229949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:19.231489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff39ff3-0d65-407f-80d4-6848ec68486c service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:19.240661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1177/2329] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:20.511110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:20.512894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:20.577900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd9ab-f9f7-483a-9502-4e9c57134529 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:20.581482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:20.582140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:20.582438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:20.582819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:20.584593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:20.656814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:20.658368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb776c-348e-43d0-a030-c445951829b6 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:20.668956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1153/2330] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:22.270344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:22.271326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:22.271826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:22.297939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] MFA Rules not processed for user `f07cafb516934dc5b905e8ec54266afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:22.301195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:22.303515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:22.304404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:22.304686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:22.314574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:22.332427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:22.333809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:22.413431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1178/2331] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:22.421975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1154/2332] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:03:22.436629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:22.438359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:22.465710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:22.541675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e5fe-a98e-4e94-a971-8e14821ce208 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:22.546245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:22.546929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:22.547214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:22.547492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:22.556296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:22.558077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a90bfd-5064-418c-96db-19ba166670c6 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:22.566512 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1179/2333] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:03:29.876218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:29.941637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b62128-7cd7-4d67-b05e-b66127a0aaee None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:29.946273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:29.947797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:29.948095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:29.948370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] PATH_INFO: `/v3/users/0768aa9a44184e6fbb438e40f3edd075` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:29.949579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0768aa9a44184e6fbb438e40f3edd075)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:29.951535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:29.999917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0768aa9a44184e6fbb438e40f3edd075'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.013190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0768aa9a44184e6fbb438e40f3edd075'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.021345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0768aa9a44184e6fbb438e40f3edd075'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.030542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0768aa9a44184e6fbb438e40f3edd075'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.031466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0768aa9a44184e6fbb438e40f3edd075'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.038448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1155/2334] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:03:29 2022] DELETE /identity/v3/users/0768aa9a44184e6fbb438e40f3edd075 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:30.043458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.043926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.044037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.063860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:30.065162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:30.129073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1180/2335] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:30.139702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.141115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:30.173598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:30.201774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c513b39-5d47-4edd-a35f-ecdc44bc169e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.205382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.206029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.206340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.206617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.215605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.217023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d55283-a0f9-45a9-965e-d8f7a8ff4692 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.226392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1156/2336] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:03:30.501524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.503264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:30.521774 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a47817-cb8c-4ed3-a368-c028c1145ff4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.527785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.528667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.528967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.529281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] PATH_INFO: `/v3/projects/868fbab2a9a945cc84954fa1729ab375` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.530715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868fbab2a9a945cc84954fa1729ab375)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.532908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.583758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868fbab2a9a945cc84954fa1729ab375', 'request_id': 'req-a44444ac-3087-4aae-9767-cac780e98953'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.589290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868fbab2a9a945cc84954fa1729ab375', 'request_id': 'req-a44444ac-3087-4aae-9767-cac780e98953'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.596309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868fbab2a9a945cc84954fa1729ab375', 'request_id': 'req-a44444ac-3087-4aae-9767-cac780e98953'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.607846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] The token cache is being invalidate because project 868fbab2a9a945cc84954fa1729ab375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:03:30.608137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.608769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a44444ac-3087-4aae-9767-cac780e98953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:30.610616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1181/2337] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:03:30 2022] DELETE /identity/v3/projects/868fbab2a9a945cc84954fa1729ab375 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:30.615503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.615797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.616078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.634455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:30.635775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:30.694330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1157/2338] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:30.702295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.702588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.702865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.721570 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:30.722810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:30.731262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1182/2339] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:30.735542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.746082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31e49-d5a6-4426-8a9d-879a1248ab15 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.750692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.751340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.751621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.751895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.752623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:03:30.752926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.754566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.766361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1158/2340] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:03:30.770495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.780678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097605d8-dcec-4531-b186-ff250bca6c81 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.785487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.786182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.786501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.786779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.787501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.789465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.804307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:30.821164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1183/2341] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:03:30 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:03:30.825524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.835812 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfed7-7889-4976-839b-62b84a3cb35f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.892414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.893083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.893359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.893629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.894355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.896264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.917541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1159/2342] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:03:30 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:03:30.921642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.932124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5176a6-4c77-4430-8216-0137bb9e1c4c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.936866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.937529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.937810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.938091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.938932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.940535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.951510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1184/2343] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:03:30.955436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:30.966233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9c26-f578-42f1-b83b-fe52418eb528 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:30.971046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:30.971709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:30.972112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:30.972398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:30.973136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:30.974790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91333-bf3b-4e16-8c15-78cecb7a34c8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:30.986629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1160/2344] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:03:30.990935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:31.001595 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7844ad-abb8-45f2-9552-7283879a9596 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:31.006305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:31.007190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:31.007468 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:31.007741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] PATH_INFO: `/v3/projects/66ad217c49a44a7f8bbfe1688219c86e/users/d68e8ab5fb684a97ae3e26da8286974b/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:31.022926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ad217c49a44a7f8bbfe1688219c86e, user_id=d68e8ab5fb684a97ae3e26da8286974b, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:31.026775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:31.040040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1185/2345] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:03:30 2022] PUT /identity/v3/projects/66ad217c49a44a7f8bbfe1688219c86e/users/d68e8ab5fb684a97ae3e26da8286974b/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:31.051337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71c4f-0579-443b-8ed9-8e13961ca19d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:31.051717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71c4f-0579-443b-8ed9-8e13961ca19d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:31.052065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71c4f-0579-443b-8ed9-8e13961ca19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:31.078853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b3f71c4f-0579-443b-8ed9-8e13961ca19d None None] MFA Rules not processed for user `d68e8ab5fb684a97ae3e26da8286974b`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:31.080069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b3f71c4f-0579-443b-8ed9-8e13961ca19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:31.108493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:31.148097 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1161/2346] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:31.159318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:31.161039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:31.220044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf1dd8-fc91-4e81-bd04-94c6e4ee5ad4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:31.223832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:31.224478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:31.224765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:31.225045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:31.234100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:31.235825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:31.244781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1186/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:37.341991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844dc6-e5b4-4d08-b67d-27b91aaf6801 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:37.342653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844dc6-e5b4-4d08-b67d-27b91aaf6801 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:37.342653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844dc6-e5b4-4d08-b67d-27b91aaf6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:37.360873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-4b844dc6-e5b4-4d08-b67d-27b91aaf6801 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:37.362067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4b844dc6-e5b4-4d08-b67d-27b91aaf6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:37.422452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1162/2348] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:03:37.438472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:37.439845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:37.514178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56764356-353e-403e-92a5-3f7e2d701f5a service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:37.520169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:37.520921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:37.521340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:37.521742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:37.530473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:37.532045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:37.541376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1187/2349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:40.610193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:40.610763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:40.610763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:40.628588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:40.629785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:40.638371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1163/2350] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:40.655566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:40.667443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca547-b115-493f-bdda-1227dd3abc19 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:40.672899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:40.673560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:40.673846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:40.674154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:40.682516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:40.684197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4494a2-7307-4c54-9b09-0ce858438eb2 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:40.693627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1188/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:41.222685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:41.232700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a74d33-61a5-4861-b140-93c54161110d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:41.237453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:41.238342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:41.238625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:41.238901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] PATH_INFO: `/v3/users/d68e8ab5fb684a97ae3e26da8286974b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:41.240077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68e8ab5fb684a97ae3e26da8286974b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:41.241976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:41.297122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68e8ab5fb684a97ae3e26da8286974b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.309859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68e8ab5fb684a97ae3e26da8286974b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.316846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68e8ab5fb684a97ae3e26da8286974b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.324951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68e8ab5fb684a97ae3e26da8286974b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.325715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68e8ab5fb684a97ae3e26da8286974b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.331797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1164/2352] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:03:41 2022] DELETE /identity/v3/users/d68e8ab5fb684a97ae3e26da8286974b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:41.336265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:41.336614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:41.336961 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:41.355903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:41.357109 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:41.388481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:41.429720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1189/2353] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:41.440437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:41.441857 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:41.478987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:03:41.504868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0521-9aa6-453f-bd09-7efdd8b62532 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:41.508522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:41.509170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:41.510074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:41.510486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:41.520797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:41.522275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079d509-1d71-4649-a4d3-ca2a6e299640 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:41.532152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1165/2354] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:41.792965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:41.795037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:41.809944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd572a7-bf7a-43a5-83af-3c8a3603f83d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:41.814599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:41.815489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:41.815771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:41.816051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] PATH_INFO: `/v3/projects/66ad217c49a44a7f8bbfe1688219c86e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:41.817246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ad217c49a44a7f8bbfe1688219c86e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:41.820238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:41.867049 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ad217c49a44a7f8bbfe1688219c86e', 'request_id': 'req-5e751747-b1a8-45d6-b5ed-32f326f21fc7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.873612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ad217c49a44a7f8bbfe1688219c86e', 'request_id': 'req-5e751747-b1a8-45d6-b5ed-32f326f21fc7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.881333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ad217c49a44a7f8bbfe1688219c86e', 'request_id': 'req-5e751747-b1a8-45d6-b5ed-32f326f21fc7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.894964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] The token cache is being invalidate because project 66ad217c49a44a7f8bbfe1688219c86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:03:41.895252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.895902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:03:41.897481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1190/2355] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:03:41 2022] DELETE /identity/v3/projects/66ad217c49a44a7f8bbfe1688219c86e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:03:43.667378 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3c39-3ade-4157-a813-6d7ce7a7243b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:43.667922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3c39-3ade-4157-a813-6d7ce7a7243b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:43.668021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3c39-3ade-4157-a813-6d7ce7a7243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:43.685947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1c8b3c39-3ade-4157-a813-6d7ce7a7243b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:43.687199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1c8b3c39-3ade-4157-a813-6d7ce7a7243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:43.751464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1166/2356] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:43.766935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:43.768363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:43.844630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751747-b1a8-45d6-b5ed-32f326f21fc7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:43.850153 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:43.850806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:43.851091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:43.851372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:43.861146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:43.862807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:43.872506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1191/2357] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:46.795055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cfa8-a8ee-40e0-9fee-9bb3166ca400 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:46.795560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cfa8-a8ee-40e0-9fee-9bb3166ca400 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:46.795671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cfa8-a8ee-40e0-9fee-9bb3166ca400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:46.814361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fe39cfa8-a8ee-40e0-9fee-9bb3166ca400 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:46.815544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fe39cfa8-a8ee-40e0-9fee-9bb3166ca400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:46.824142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1167/2358] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:46.839238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:46.840574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:46.855177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca6a9d-e7cc-4571-b483-7f1985647fae service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:46.861553 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:46.862233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:46.862514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:46.862783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:46.872053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:46.873635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:46.883023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1192/2359] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:03:49.954703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a2b6-a14e-4577-8938-449fb70e0d6e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:49.955175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a2b6-a14e-4577-8938-449fb70e0d6e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:49.955268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a2b6-a14e-4577-8938-449fb70e0d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:49.973748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-1111a2b6-a14e-4577-8938-449fb70e0d6e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:03:49.974955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1111a2b6-a14e-4577-8938-449fb70e0d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:03:49.983120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1168/2360] 10.222.0.39 () {58 vars in 1016 bytes} [Tue May 24 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:03:50.019242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:03:50.031191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f4a5-76b3-4b12-987d-18946bf36203 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:03:50.036670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:03:50.037304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:03:50.037593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:03:50.037871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:03:50.046262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:03:50.047838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:03:50.057744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1193/2361] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:03:59.968658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=44 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:00.052997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:13.381074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:04:13.381524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:04:13.381620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:04:13.401565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] MFA Rules not processed for user `96d14f2ef79a4fac94127b2274ea88e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:04:13.402802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:04:13.464343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1169/2362] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:04:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:04:21.502001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:04:21.503489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:04:21.516313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe051ca-7c89-46d7-bfc7-941750e52979 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:04:21.521047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:04:21.521919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:04:21.522237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:04:21.522541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] PATH_INFO: `/v3/users/f07cafb516934dc5b905e8ec54266afb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:04:21.524286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07cafb516934dc5b905e8ec54266afb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:04:21.526234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:04:21.573020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07cafb516934dc5b905e8ec54266afb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:21.573676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07cafb516934dc5b905e8ec54266afb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:21.574339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07cafb516934dc5b905e8ec54266afb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:21.586737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07cafb516934dc5b905e8ec54266afb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:21.593854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-222cc081-8974-4fa3-a577-6adc170a62d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07cafb516934dc5b905e8ec54266afb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:21.606699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1194/2363] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:04:21 2022] DELETE /identity/v3/users/f07cafb516934dc5b905e8ec54266afb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:04:21.931493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:04:21.955435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec563d-c12f-4a37-816e-23e4a0b03089 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:04:22.038474 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:04:22.039397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:04:22.039699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:04:22.039970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] PATH_INFO: `/v3/projects/f80a6168db284f629818111237846592` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:04:22.041127 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80a6168db284f629818111237846592)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:04:22.043055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:04:22.089886 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80a6168db284f629818111237846592', 'request_id': 'req-1bf175bc-a400-4aef-95a1-6e1522a10035'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:22.095995 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80a6168db284f629818111237846592', 'request_id': 'req-1bf175bc-a400-4aef-95a1-6e1522a10035'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:22.102552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80a6168db284f629818111237846592', 'request_id': 'req-1bf175bc-a400-4aef-95a1-6e1522a10035'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:22.112863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] The token cache is being invalidate because project f80a6168db284f629818111237846592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:04:22.113147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:22.113761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1bf175bc-a400-4aef-95a1-6e1522a10035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:04:22.115312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1170/2364] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:04:21 2022] DELETE /identity/v3/projects/f80a6168db284f629818111237846592 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:04:23.229404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:04:23.229919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:04:23.230046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:04:23.247775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] MFA Rules not processed for user `80d7626dce354de8af8ce1894665c477`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:04:23.248890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:04:23.304286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1195/2365] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:04:32.109917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:33.297487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:04:42.522512 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:04:42.522983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:04:42.523107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:04:42.540947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] MFA Rules not processed for user `05e1bcfc943d49c588dc050de517a465`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:04:42.542135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:04:42.597631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1171/2366] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:04:52.590225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=25 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:06.576018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:06.577624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:06.640228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835ded8-76b0-427c-8d48-1501c294b90d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:06.644260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:06.645181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:06.645466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:06.645743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:06.647593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:06.728329 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:06.729848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:06.741804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1196/2367] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:08.041588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:08.051018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd8b2c-1184-48a2-b593-bff6708a76ae None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:08.054757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:08.055551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:08.055839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:08.056114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:08.057877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:08.071246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:08.072665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612a3e3-a004-476c-9c59-f306976cca6e service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:08.083510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1172/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:14.965380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:14.967232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:14.982099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0973-a7fe-4ca8-beff-cc66bb76decf service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:14.988729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:14.988890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:14.989298 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:14.989653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:14.992080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:15.003263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:15.004982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:15.015478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1197/2369] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:16.783690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:16.784217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:16.784327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:16.802640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:16.803976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:16.863361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1173/2370] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:05:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:16.912825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:16.914340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:16.985974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091deaa7-7605-480b-8dc2-62a001c04d3c service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:16.991059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:16.992270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:16.992554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:16.992829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:17.001706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:17.003363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:17.012226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1198/2371] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:05:18.958978 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:18.971703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf54a5-c570-494c-a7df-2c796098826d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:18.977815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:18.978492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:18.978776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:18.979051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:18.981089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:19.050368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:19.052010 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:19.063142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1174/2372] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:24.857304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:24.858934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:24.880826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:24.926521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426d8fe-06bd-4bcd-86a9-015656af2cb5 service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:24.931534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:24.932392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:24.932670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:24.932944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] PATH_INFO: `/v3/users/15872c8688cd42ebbc0eab8bf7f0d064` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:24.934106 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] RBAC: Authorizing `identity:delete_user(user_id=15872c8688cd42ebbc0eab8bf7f0d064)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:24.936043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:24.982435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15872c8688cd42ebbc0eab8bf7f0d064'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:24.983089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15872c8688cd42ebbc0eab8bf7f0d064'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:24.983695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15872c8688cd42ebbc0eab8bf7f0d064'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:24.995256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15872c8688cd42ebbc0eab8bf7f0d064'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.002018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15872c8688cd42ebbc0eab8bf7f0d064'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.015627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1199/2373] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:24 2022] DELETE /identity/v3/users/15872c8688cd42ebbc0eab8bf7f0d064 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:25.202473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:25.216540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dcd6b-ae59-4d8b-ab3d-a7d6d967bd5f service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:25.279869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:25.280752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:25.281039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:25.281317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] PATH_INFO: `/v3/projects/0494821f2c9544dca6b26eb37178a82b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:25.282552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0494821f2c9544dca6b26eb37178a82b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:25.284483 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:25.324285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:25.338161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0494821f2c9544dca6b26eb37178a82b', 'request_id': 'req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.344429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0494821f2c9544dca6b26eb37178a82b', 'request_id': 'req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.354759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0494821f2c9544dca6b26eb37178a82b', 'request_id': 'req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.367060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] The token cache is being invalidate because project 0494821f2c9544dca6b26eb37178a82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:25.367352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.368007 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.369574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1175/2374] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:25 2022] DELETE /identity/v3/projects/0494821f2c9544dca6b26eb37178a82b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:25.373636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:25.377001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:25.391721 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eee83-1366-4528-b85d-fb9165dd08af admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:25.456699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:25.457602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:25.457889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:25.458193 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] PATH_INFO: `/v3/users/499719d75fde4388a7fcb2bdb27b216e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:25.459371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499719d75fde4388a7fcb2bdb27b216e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:25.461452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:25.503401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:25.511561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499719d75fde4388a7fcb2bdb27b216e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.512346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499719d75fde4388a7fcb2bdb27b216e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.513325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499719d75fde4388a7fcb2bdb27b216e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.524897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499719d75fde4388a7fcb2bdb27b216e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.531626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499719d75fde4388a7fcb2bdb27b216e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.544026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1200/2375] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:25 2022] DELETE /identity/v3/users/499719d75fde4388a7fcb2bdb27b216e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:25.713119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:25.714604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:25.733122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdf9b7-72c6-4793-a14a-0e2fb367229d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:25.792573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:25.793445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:25.793757 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:25.794036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] PATH_INFO: `/v3/projects/1d00de35c17e49bda8ecace9d97553b6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:25.795247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d00de35c17e49bda8ecace9d97553b6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:25.797158 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:25.844606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d00de35c17e49bda8ecace9d97553b6', 'request_id': 'req-798800dc-1744-4e57-82a8-366c6c48f50a'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.850662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d00de35c17e49bda8ecace9d97553b6', 'request_id': 'req-798800dc-1744-4e57-82a8-366c6c48f50a'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.858396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d00de35c17e49bda8ecace9d97553b6', 'request_id': 'req-798800dc-1744-4e57-82a8-366c6c48f50a'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.869263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] The token cache is being invalidate because project 1d00de35c17e49bda8ecace9d97553b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:25.869547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.870194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:25.871741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1176/2376] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:25 2022] DELETE /identity/v3/projects/1d00de35c17e49bda8ecace9d97553b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:29.848726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:29.850159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:29.906769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38b02-b239-4d89-891a-77bc1ceba747 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:29.954564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:29.955134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:29.955416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:29.955691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:29.957421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:30.021557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:30.023576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012099d9-7477-453d-8880-1277fa64d19d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:30.033529 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1201/2377] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:31.411349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:31.412814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:31.483963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:31.512816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:31.513796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:31.514278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:31.516222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798800dc-1744-4e57-82a8-366c6c48f50a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:31.521468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:31.522144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:31.522443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:31.522725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:31.526041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:31.535652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:31.536978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:31.561785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:31.595156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:31.596680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:31.608484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1177/2378] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:31.610943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1202/2379] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:05:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:31.625106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:31.626535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:31.733604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b49f-a6b3-44d4-9004-362d3a4c5514 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:31.739815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:31.741202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:31.741490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:31.742511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:31.755205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:31.756961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:31.775529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1178/2380] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:05:34.321866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:34.326651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:34.343312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814179-eaf5-42e7-8ec5-0e310880328e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:34.349010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:34.350076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:34.350456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:34.350800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] PATH_INFO: `/v3/users/80d7626dce354de8af8ce1894665c477` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:34.352745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d7626dce354de8af8ce1894665c477)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:34.354833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:34.420431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d7626dce354de8af8ce1894665c477'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.421370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d7626dce354de8af8ce1894665c477'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.421990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d7626dce354de8af8ce1894665c477'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.438761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d7626dce354de8af8ce1894665c477'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.453909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-00be7167-d699-464d-a6df-4e459ad9b3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d7626dce354de8af8ce1894665c477'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.486941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1203/2381] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:34 2022] DELETE /identity/v3/users/80d7626dce354de8af8ce1894665c477 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:34.756233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:34.770918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1aa8f-d167-45e6-9a18-003c0575ef09 service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:34.873131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:34.874135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:34.874492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:34.874776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] PATH_INFO: `/v3/projects/db7b0552512b4ddbb7a40ee485606d5c` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:34.875949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7b0552512b4ddbb7a40ee485606d5c)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:34.877898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:34.908098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:34.945714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7b0552512b4ddbb7a40ee485606d5c', 'request_id': 'req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.952724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7b0552512b4ddbb7a40ee485606d5c', 'request_id': 'req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.965807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7b0552512b4ddbb7a40ee485606d5c', 'request_id': 'req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.990247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] The token cache is being invalidate because project db7b0552512b4ddbb7a40ee485606d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:34.990642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.991475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b25dd8a4-72bd-45df-a2e9-3e0c4a845f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:34.994532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1179/2382] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:34 2022] DELETE /identity/v3/projects/db7b0552512b4ddbb7a40ee485606d5c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:34.999664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183039-0421-447f-99a6-a311fc802c98 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.007108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183039-0421-447f-99a6-a311fc802c98 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.009371 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183039-0421-447f-99a6-a311fc802c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.069125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-16183039-0421-447f-99a6-a311fc802c98 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:35.071053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-16183039-0421-447f-99a6-a311fc802c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:35.152365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1204/2383] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:35.154743 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.155417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.155845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.175697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:35.177076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:35.192269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1180/2384] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:35.193250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16183039-0421-447f-99a6-a311fc802c98 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.209764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16183039-0421-447f-99a6-a311fc802c98 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.215171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.215837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.216128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.216409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.217138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:05:35.217446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.219121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.238966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1205/2385] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:05:35.240198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.250891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e4d6-9347-4209-b903-145ec7d8a9b7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.255906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.256660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.257016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.258649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.259667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.262616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.300322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1181/2386] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:35.301506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.313273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049831-48cf-47ac-9f08-908fb1e63713 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.342459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:35.381889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.383447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.383738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.384020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.384834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.386872 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.413130 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1206/2387] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:35.415131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.427695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71060a-f92c-4ff7-9402-990b5e51a0be admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.433514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.438167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.438167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.438167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.438167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.438167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.449939 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1182/2388] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:35.454462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.465691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9329d6-f258-4502-8878-453ede9966bd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.470825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.471709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.472003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.472284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.473050 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.474796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119371b-1424-413b-a220-bf4f3654105a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.487666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1207/2389] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:35.492611 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.503788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71923-3cad-405a-b152-c34e7387ed01 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.509539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.510686 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.511045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.511407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] PATH_INFO: `/v3/projects/89d94d27c1a74ab4b24e2fa46bdd4593/users/f7e3e8fc1c324e4d8bf079a61aa2bede/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.538989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d94d27c1a74ab4b24e2fa46bdd4593, user_id=f7e3e8fc1c324e4d8bf079a61aa2bede, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.541650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.574977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1183/2390] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:35 2022] PUT /identity/v3/projects/89d94d27c1a74ab4b24e2fa46bdd4593/users/f7e3e8fc1c324e4d8bf079a61aa2bede/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:35.585373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.586201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.586520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.614819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] MFA Rules not processed for user `f7e3e8fc1c324e4d8bf079a61aa2bede`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:35.616034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:35.696227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1208/2391] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:35.700685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.768354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6ffc-5bfb-4adb-89c2-a4c28a2d7119 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.776641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.777326 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.777610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.777888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.778628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.780552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.810932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1184/2392] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:35.823443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.837594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00755-ea3b-4020-8f59-c615007cc5d9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.927943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.928632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.928921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.929925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.931070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.933028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:35.966433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1209/2393] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:35 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:35.970550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:35.983684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fe8fa-6773-4e8b-94e7-995571e33a56 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:35.993466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:35.994320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:35.994746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:35.995361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:35.996254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:35.998217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.020769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1185/2394] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:05:36.022070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:36.036965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb55d-b7f8-40d7-86f4-7a221150a6cc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:36.043687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:36.044708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.045244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.045626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] PATH_INFO: `/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61/users/3fbfb936e1c8416490759b88d3c44fd7/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.067956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d9b68c3dd94d259ba5cd2e6d7b2b61, user_id=3fbfb936e1c8416490759b88d3c44fd7, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:36.071944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.089481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:36.097967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1210/2395] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:36 2022] PUT /identity/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61/users/3fbfb936e1c8416490759b88d3c44fd7/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:05:36.099267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:36.124847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46245887-a2ca-4e71-8726-a6bd85aa40b3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:36.157916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:36.281333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:36.282287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.282488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.282791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.284647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:36.296205 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6225-b450-4a2b-a36d-4c49f74704cf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.318555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1186/2396] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:36.323422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:36.336823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8385-2cb2-4d3b-ab0d-8bdcafc1bedc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:36.349649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:36.349649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.349649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.349649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] PATH_INFO: `/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61/users/3fbfb936e1c8416490759b88d3c44fd7/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.350947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d9b68c3dd94d259ba5cd2e6d7b2b61, user_id=3fbfb936e1c8416490759b88d3c44fd7, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:36.352715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.378284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.378796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.379291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.381429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1211/2397] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:36 2022] PUT /identity/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61/users/3fbfb936e1c8416490759b88d3c44fd7/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:36.423054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] MFA Rules not processed for user `3fbfb936e1c8416490759b88d3c44fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:36.423054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:36.531917 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1187/2398] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:36.544253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:36.548508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:36.617669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a55b-762a-45c5-973e-64d33c7e00cf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:36.624824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:36.625683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.625971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.626295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.639038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:36.641836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.656467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1212/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:36.751406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:36.765393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204896d9-0d69-4a09-affe-b15d725fd59d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:36.769885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:36.770613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:36.770928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:36.771209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:36.849083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:36.852562 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9c807-06ef-4912-9a59-0b35f56298d8 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:36.864442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1188/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:39.746739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:39.830047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904dde1-f119-4390-a534-91132ca0237f service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:39.834947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:39.835930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:39.836301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:39.836863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] PATH_INFO: `/v3/users/f7e3e8fc1c324e4d8bf079a61aa2bede` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:39.838144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e3e8fc1c324e4d8bf079a61aa2bede)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:39.841209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:39.902764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e3e8fc1c324e4d8bf079a61aa2bede'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:39.903574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e3e8fc1c324e4d8bf079a61aa2bede'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:39.904191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e3e8fc1c324e4d8bf079a61aa2bede'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:39.922356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e3e8fc1c324e4d8bf079a61aa2bede'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:39.935763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e3e8fc1c324e4d8bf079a61aa2bede'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:39.982391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1213/2401] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:39 2022] DELETE /identity/v3/users/f7e3e8fc1c324e4d8bf079a61aa2bede => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:39.982503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:39.982503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:39.982503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:40.003529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:40.004920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:40.064094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:40.105507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1189/2402] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:40.115307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:40.117877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:40.137005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:40.231082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e27ac-8b23-45f9-b35d-d071126bfe33 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:40.234690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:40.235345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:40.235629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:40.235935 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:40.248163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:40.248163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:40.258045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1214/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:40.692948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:40.694316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:40.715789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ccfe-10bd-47fc-a51f-d054e214a4ad None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:40.723497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:40.723932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:40.724235 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:40.724514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] PATH_INFO: `/v3/projects/89d94d27c1a74ab4b24e2fa46bdd4593` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:40.726571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d94d27c1a74ab4b24e2fa46bdd4593)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:40.728516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:40.791646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d94d27c1a74ab4b24e2fa46bdd4593', 'request_id': 'req-ad63af7e-85ae-46cb-ac7e-914a800362e8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.798996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d94d27c1a74ab4b24e2fa46bdd4593', 'request_id': 'req-ad63af7e-85ae-46cb-ac7e-914a800362e8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.810163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d94d27c1a74ab4b24e2fa46bdd4593', 'request_id': 'req-ad63af7e-85ae-46cb-ac7e-914a800362e8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.827904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] The token cache is being invalidate because project 89d94d27c1a74ab4b24e2fa46bdd4593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:40.828287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.830244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.831890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1190/2404] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:40 2022] DELETE /identity/v3/projects/89d94d27c1a74ab4b24e2fa46bdd4593 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:40.836102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:40.846100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2addf50-1d07-4662-8226-73fda5263fc4 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:40.919492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:40.920409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:40.920694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:40.920971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] PATH_INFO: `/v3/users/3fbfb936e1c8416490759b88d3c44fd7` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:40.922816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbfb936e1c8416490759b88d3c44fd7)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:40.924997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:40.986773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbfb936e1c8416490759b88d3c44fd7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.987473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbfb936e1c8416490759b88d3c44fd7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:40.988429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbfb936e1c8416490759b88d3c44fd7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.003270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbfb936e1c8416490759b88d3c44fd7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.017097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ae1a571e-2ac4-45d4-8ec9-bb49317a9f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbfb936e1c8416490759b88d3c44fd7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.034738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1215/2405] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:40 2022] DELETE /identity/v3/users/3fbfb936e1c8416490759b88d3c44fd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:41.484524 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:41.485899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:41.503763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63af7e-85ae-46cb-ac7e-914a800362e8 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:41.573620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:41.574602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:41.575145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:41.575676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] PATH_INFO: `/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:41.577209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d9b68c3dd94d259ba5cd2e6d7b2b61)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:41.579621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:41.646186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d9b68c3dd94d259ba5cd2e6d7b2b61', 'request_id': 'req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.654450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d9b68c3dd94d259ba5cd2e6d7b2b61', 'request_id': 'req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.665297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d9b68c3dd94d259ba5cd2e6d7b2b61', 'request_id': 'req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.667830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:41.679639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] The token cache is being invalidate because project 10d9b68c3dd94d259ba5cd2e6d7b2b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:41.680244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.681054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3fd834fe-7c59-49ce-84e3-3a5b44fbf25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:41.682959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1191/2406] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:41 2022] DELETE /identity/v3/projects/10d9b68c3dd94d259ba5cd2e6d7b2b61 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:05:41.688087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:41.688482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:41.688773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:41.710011 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:41.712558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:41.744191 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:41.806396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1216/2407] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:41.812313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:41.812601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:41.812878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:41.834370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:41.837123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:41.852724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1192/2408] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:41.853902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:41.867741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551faa-f807-48a8-a000-976f5893efb6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:41.878433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:41.879090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:41.879372 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:41.879644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:41.880386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:05:41.880766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:41.883299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:41.896480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1217/2409] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:05:41.901473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:41.912601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd087-d427-4ae9-96b6-261ee1533b49 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:41.921615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:41.923250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:41.923667 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:41.924040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:41.928896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:41.928896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:41.963414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1193/2410] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:41 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:41.967797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:41.981237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eecfeb-1550-400e-96ab-de0d64d622ee admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.055433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.056292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.056583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.056863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.057561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.061694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.094292 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1218/2411] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:41 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:42.097236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.111052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1ea2b-04c6-4ae5-80e7-9ca1260f3807 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.115988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.116844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.117142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.117415 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.118277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.120061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.139480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1194/2412] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:42.140312 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.153433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9b7ca-d098-4506-bc71-d8069b0d1627 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.159252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.160259 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.160779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.161303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.162467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.164578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dd64c-27c3-48b1-88a9-d2379758a94a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.189031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1219/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:05:42.193272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.205747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3547f-ea3a-4be2-9a74-686bfd5a4911 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.229339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.230804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.232615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.232615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] PATH_INFO: `/v3/projects/a4edf21790dd4474b480bd3e05d8e674/users/a141135626be4ebca5dede606d557729/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.250732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4edf21790dd4474b480bd3e05d8e674, user_id=a141135626be4ebca5dede606d557729, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.253938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.277377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1195/2414] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:42 2022] PUT /identity/v3/projects/a4edf21790dd4474b480bd3e05d8e674/users/a141135626be4ebca5dede606d557729/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:42.288602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.288895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.289184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.319327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] MFA Rules not processed for user `a141135626be4ebca5dede606d557729`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:42.320738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:42.394098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1220/2415] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:42.398735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.462617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95056135-4aff-4f92-918a-8464defe7128 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.467315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.467977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.468265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.468544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.470400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.472696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.503253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1196/2416] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:42 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:05:42.506947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.518589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d3deb-0f91-4ae2-b10f-0ba9b36669cf None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.547236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:42.593787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.594580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.594982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.595319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.596190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.598620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.624546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1221/2417] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:42 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:42.628601 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.639829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b748a-0a89-42d9-9106-82e81d2cee31 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.644633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.645305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.645594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.645873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.646635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.648927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.665069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1197/2418] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:42.669465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.684339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b3950-6e8f-4262-916e-02564b88d16c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.700617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.701812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.702102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.702400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] PATH_INFO: `/v3/projects/22df83e255644f9fb7d0ebec62c6d134/users/917de1d0abe54a0cae0009f26aba02fc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.718519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22df83e255644f9fb7d0ebec62c6d134, user_id=917de1d0abe54a0cae0009f26aba02fc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.721187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.734739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1222/2419] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:42 2022] PUT /identity/v3/projects/22df83e255644f9fb7d0ebec62c6d134/users/917de1d0abe54a0cae0009f26aba02fc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:42.738605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.749182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9847d-257d-499b-874b-a8c7a9056865 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.806685 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.807346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.807626 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.807899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.808606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.810213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eba0a-3029-46af-863c-35db01fbacce admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.812245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:42.822728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1198/2420] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:42.827234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.838317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeba6d-ead3-4b57-bfbf-999e28ae6ba8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:42.843183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:42.844116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.844347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.844625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] PATH_INFO: `/v3/projects/22df83e255644f9fb7d0ebec62c6d134/users/917de1d0abe54a0cae0009f26aba02fc/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.846593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22df83e255644f9fb7d0ebec62c6d134, user_id=917de1d0abe54a0cae0009f26aba02fc, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:42.849227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:42.859558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1223/2421] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:42 2022] PUT /identity/v3/projects/22df83e255644f9fb7d0ebec62c6d134/users/917de1d0abe54a0cae0009f26aba02fc/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:42.871491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:42.871788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:42.872078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:42.904845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] MFA Rules not processed for user `917de1d0abe54a0cae0009f26aba02fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:42.907300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:42.983318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1199/2422] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:42.993988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:42.995737 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:43.027339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:43.028801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:43.058766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b9249-ec99-43cd-b317-8cb48e774203 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:43.062594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:43.063243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:43.063534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:43.063809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:43.073804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:43.075285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:43.085868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1224/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:43.086781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675dfa6-78b7-485e-a518-6e5f8e8d17c8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:43.090453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:43.091104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:43.091394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:43.091671 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:43.093454 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:43.103428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:43.105032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:43.113016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1200/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:43.136219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:43.137650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:43.149981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a107859-e3b8-4ceb-9cec-4b2d4d3fddba service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:43.153803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:43.154477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:43.154761 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:43.155037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:43.215494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:43.216951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c0e75-354a-44fc-adcd-e7bfc15eed86 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:43.226497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1225/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:46.580426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:46.644598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e692b-3dc3-4071-ab48-af830f975dde service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:46.650018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:46.650987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:46.651271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:46.651546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] PATH_INFO: `/v3/users/a141135626be4ebca5dede606d557729` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:46.652780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a141135626be4ebca5dede606d557729)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:46.654747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:46.684540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:46.703638 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a141135626be4ebca5dede606d557729'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:46.715551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a141135626be4ebca5dede606d557729'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:46.722533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a141135626be4ebca5dede606d557729'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:46.731803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a141135626be4ebca5dede606d557729'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:46.732517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a141135626be4ebca5dede606d557729'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:46.738944 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1201/2426] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:46 2022] DELETE /identity/v3/users/a141135626be4ebca5dede606d557729 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:46.744223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:46.744704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:46.744924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:46.762450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:46.763746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:46.777539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:46.829293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1226/2427] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:46.839330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:46.841194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:46.841342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:46.843739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:46.949039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308b53-6731-46e2-b362-f898baafd301 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:46.951645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d42aab-ff5c-4e5e-b726-00aea53ae6fb None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:46.953163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:46.954899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:46.955284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:46.955581 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:46.958299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:46.959030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:46.959387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:46.960479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:46.964811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:46.967347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:46.968864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:46.981917 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:46.982308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1202/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:46.983929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:46.996228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1227/2429] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:47.455137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:47.456612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:47.471762 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01674c-3d1f-4fbc-86d7-23b10657af3a service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:47.480211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:47.480211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:47.480211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:47.480211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] PATH_INFO: `/v3/projects/a4edf21790dd4474b480bd3e05d8e674` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:47.481296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4edf21790dd4474b480bd3e05d8e674)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:47.483739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:47.564929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4edf21790dd4474b480bd3e05d8e674', 'request_id': 'req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.573897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4edf21790dd4474b480bd3e05d8e674', 'request_id': 'req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.585031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4edf21790dd4474b480bd3e05d8e674', 'request_id': 'req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.597478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] The token cache is being invalidate because project a4edf21790dd4474b480bd3e05d8e674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:47.597719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.598428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.600066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1203/2430] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:47 2022] DELETE /identity/v3/projects/a4edf21790dd4474b480bd3e05d8e674 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:47.605313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:47.616817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7756c0-261c-4a2b-8923-d40ac26b9028 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:47.678181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:47.679846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:47.680172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:47.680453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] PATH_INFO: `/v3/users/917de1d0abe54a0cae0009f26aba02fc` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:47.681658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] RBAC: Authorizing `identity:delete_user(user_id=917de1d0abe54a0cae0009f26aba02fc)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:47.683677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:47.734586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917de1d0abe54a0cae0009f26aba02fc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.735249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917de1d0abe54a0cae0009f26aba02fc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.735867 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917de1d0abe54a0cae0009f26aba02fc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.737107 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:47.752578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917de1d0abe54a0cae0009f26aba02fc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.761795 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917de1d0abe54a0cae0009f26aba02fc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:47.777134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1228/2431] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:47 2022] DELETE /identity/v3/users/917de1d0abe54a0cae0009f26aba02fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:48.129646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.131958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.133388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:48.133716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:48.222535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:48.250091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a639f-6765-42fb-998a-0fdec097619c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.260406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.261572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.262025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.262816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] PATH_INFO: `/v3/projects/22df83e255644f9fb7d0ebec62c6d134` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.264351 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22df83e255644f9fb7d0ebec62c6d134)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.268144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.297279 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd2bf-dc8a-4730-910c-43b0102bc0d9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.335433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22df83e255644f9fb7d0ebec62c6d134', 'request_id': 'req-a789a3d7-fdaa-4109-a7cf-746a7302d055'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:48.349988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22df83e255644f9fb7d0ebec62c6d134', 'request_id': 'req-a789a3d7-fdaa-4109-a7cf-746a7302d055'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:48.355382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22df83e255644f9fb7d0ebec62c6d134', 'request_id': 'req-a789a3d7-fdaa-4109-a7cf-746a7302d055'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:48.387583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] The token cache is being invalidate because project 22df83e255644f9fb7d0ebec62c6d134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:48.388302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:48.389217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a789a3d7-fdaa-4109-a7cf-746a7302d055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:48.391331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1229/2432] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:48 2022] DELETE /identity/v3/projects/22df83e255644f9fb7d0ebec62c6d134 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:48.396543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.397023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.398469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.422827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.423216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.423722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.431263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.435449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:48.439077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:48.441432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:48.453807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.455755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27d50e-bb55-44c8-a786-194086cde8d9 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.471981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1204/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:48.529015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:48.554170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1230/2434] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:48.560103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.560402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.560736 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.594443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:48.595424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:48.609269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1205/2435] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:48.610489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.622566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11913f2b-4a35-4ed6-88a1-ce428634f3c6 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.628348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.629034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.629348 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.629890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.630678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:05:48.630990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.633910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.646887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1231/2436] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:05:48.651540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.665017 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c1f36-d489-4c74-b82a-61105c9d3887 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.670784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.672020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.672020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.672518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.673296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.675319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.708655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1206/2437] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:48 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:48.713656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.726659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00881e-ba2a-49a7-bc09-0788755ac737 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.821057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.823129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.823636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.824300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.825122 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.829177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.865145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1232/2438] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:48 2022] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:48.870277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.884397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6daf6-2d00-4bae-a5a8-d82d20da2211 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.893777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.895181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.895882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.896506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.897654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.900031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.918547 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1207/2439] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:48.919212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.932433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50dba2-4cc2-4736-9a9a-63d8bcd6d3e8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.938994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.940296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.941568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.942101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:48.943103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:48.945826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae057fe7-b6f3-4523-87e8-f9630be0ec38 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:48.967394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1233/2440] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:48.969074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:48.983569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777157ac-c3d7-4ac3-a341-3026666e3614 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:48.995552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:48.997333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:48.997835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:48.998584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] PATH_INFO: `/v3/projects/62b9cd35ca0649b7b4add7dac1e091fb/users/5dd66e3e017c42f4bff27933fcbfad83/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.027555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b9cd35ca0649b7b4add7dac1e091fb, user_id=5dd66e3e017c42f4bff27933fcbfad83, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.030747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0d0d-66a7-4ccc-b722-81fc1d7aa679 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.062206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1208/2441] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:48 2022] PUT /identity/v3/projects/62b9cd35ca0649b7b4add7dac1e091fb/users/5dd66e3e017c42f4bff27933fcbfad83/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:05:49.064478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.064776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.065057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.075665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8967dd-0206-4bea-93a4-7eede7b036ee None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.076043 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8967dd-0206-4bea-93a4-7eede7b036ee None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.078423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8967dd-0206-4bea-93a4-7eede7b036ee None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.080145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1209/2442] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:05:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 13:05:49.091755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.092095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.092375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.113496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:49.115133 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.119946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] MFA Rules not processed for user `5dd66e3e017c42f4bff27933fcbfad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:49.121633 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.172558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:49.207688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1210/2443] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:49.218888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1234/2444] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:49.223249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.224288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.226822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.300194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:49.303945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded3d29-ccb9-4979-b566-e740af599136 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.308051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.308981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.309342 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.309699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.314773 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b678f-6b1b-4897-a44b-4cf04198871b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.323862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.324091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.325033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.325326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.325609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.325720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.326344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.329350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8dad-bcec-4852-8064-62f1756e9027 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.338654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1211/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:49.393697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1235/2446] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/projects => generated 407 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:05:49.395526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.414526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b624002-89f7-4f4f-9c8e-9d94ddc17aab service glance] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.438555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942969a-dbc2-41ec-a71f-ab09a4253cde None None] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.438914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942969a-dbc2-41ec-a71f-ab09a4253cde None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.439121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942969a-dbc2-41ec-a71f-ab09a4253cde None None] PATH_INFO: `/` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.440741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1236/2447] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 13:05:49.447237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.447578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.447865 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.471460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] MFA Rules not processed for user `4c9d6becc7f8440e88cc2a3a043ac824`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:49.472859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.510731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.511730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.511730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.511931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.512558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.514511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.541962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1212/2448] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/users => generated 310 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:49.543124 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.545044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1237/2449] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:49.554652 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e303bc-35af-41ed-9863-2d2bf3aee8c9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.557768 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.559528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.559837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.560555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.560841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.561121 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.561860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.563558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.572374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb323827-70b3-4d32-8782-331877f84ecc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.576364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.577244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.577531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.577637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1213/2450] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:49.577811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.581752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.587704 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.589385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.592676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d3c4c-45c2-459e-904d-5b6491f6350e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.597871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.598852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.599135 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.599634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1238/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:49.602313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] PATH_INFO: `/v3/projects/3d74ecedd88c4411819074107b963161/users/c24d0d24f6d641f28ce63c89c6682fb2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.620568 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74ecedd88c4411819074107b963161, user_id=c24d0d24f6d641f28ce63c89c6682fb2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.624075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432afd2-2580-4726-b385-c0473287f71f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.640202 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1214/2452] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:49 2022] PUT /identity/v3/projects/3d74ecedd88c4411819074107b963161/users/c24d0d24f6d641f28ce63c89c6682fb2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:05:49.644369 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.658576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25902ef7-351c-44db-8e29-d93ab9d1b26b service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.699317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758324-68d8-4284-8c89-9c61fb99bc43 None None] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.699646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758324-68d8-4284-8c89-9c61fb99bc43 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.699904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758324-68d8-4284-8c89-9c61fb99bc43 None None] PATH_INFO: `/` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.701381 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1215/2453] 10.222.0.36 () {54 vars in 921 bytes} [Tue May 24 13:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 13:05:49.707352 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.707656 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.707919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.727746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] MFA Rules not processed for user `0532ebb4e77b41179663accaa80e4942`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:49.728973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.729107 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.730092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.730452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.730797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.731652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.733377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.749951 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1239/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:05:49.753844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.765252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f84b3e-aef0-4c88-b15a-1406fe9bb1ab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.770090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.771154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.771452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.771732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] PATH_INFO: `/v3/projects/3d74ecedd88c4411819074107b963161/users/c24d0d24f6d641f28ce63c89c6682fb2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.774056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74ecedd88c4411819074107b963161, user_id=c24d0d24f6d641f28ce63c89c6682fb2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:49.774712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:49.776871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a5e2-cd68-402e-bb8a-eab50dac9616 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:49.789508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1240/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:49 2022] PUT /identity/v3/projects/3d74ecedd88c4411819074107b963161/users/c24d0d24f6d641f28ce63c89c6682fb2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:49.799885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.800220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.800462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:49.815741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1216/2456] 10.222.0.36 () {58 vars in 1018 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:49.833238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.833753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] MFA Rules not processed for user `c24d0d24f6d641f28ce63c89c6682fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:49.835422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.889455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:49.901327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33a67-f0cf-4e5a-b64a-8a00c3c10e09 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:49.929158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1241/2457] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:49.939934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:49.941446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:49.958887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:49.960105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:49.961046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:49.961370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:50.014245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437fc9-56db-47ea-976e-6358219a71a1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:50.018663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:50.019258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:50.019679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:50.019983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:50.039347 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:50.040796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:50.045157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:50.046695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:50.050797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1242/2458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:50.059451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1217/2459] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:50.136287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:50.137648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:50.221210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542abb0-e502-4541-af12-b4c0965499e5 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:50.227767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:50.228514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:50.228885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:50.229226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:50.230314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:50.231537 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:50.239740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bf281-7a90-4f1a-8629-8e05fa9712f7 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:50.243744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:50.244385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:50.244590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:50.244698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:50.244938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:50.246212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c883-f413-4748-b232-7d06e71fb12c service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:50.256284 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1243/2460] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:50.274066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:50.306695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:50.308229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:50.316952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1218/2461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:51.780308 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:51.780803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:51.780911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:51.800149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:51.801364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:51.866964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1244/2462] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:51.882943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:51.885045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:51.961195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5725b5-0099-4db1-8dec-b258f7758f7e service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:51.966560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:51.967201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:51.967484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:51.967761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:51.976665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:51.978300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:51.987016 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1219/2463] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:05:53.537200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:53.551586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f521790-53b8-4ac6-b71d-62688e0aca41 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:53.559105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:53.559933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:53.560288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:53.560622 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:53.564169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:53.580968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:53.636901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:53.638620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf31c58-738e-48ee-995c-91860306e2c6 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:53.649778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1245/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:05:55.930789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:55.942019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87a51-a51b-4813-9510-4ce4e162721f service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:55.948088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:55.949151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:55.950022 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:55.950404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] PATH_INFO: `/v3/users/5dd66e3e017c42f4bff27933fcbfad83` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:55.951901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd66e3e017c42f4bff27933fcbfad83)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:55.955040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:56.029341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd66e3e017c42f4bff27933fcbfad83'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:56.046634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd66e3e017c42f4bff27933fcbfad83'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:56.060025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd66e3e017c42f4bff27933fcbfad83'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:56.084095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd66e3e017c42f4bff27933fcbfad83'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:56.085799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd66e3e017c42f4bff27933fcbfad83'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:56.098486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1220/2465] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:55 2022] DELETE /identity/v3/users/5dd66e3e017c42f4bff27933fcbfad83 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:56.103436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:56.103936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:56.104556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:56.126013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:56.127926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:56.261498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1246/2466] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:56.274061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:56.275729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:56.327913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:56.367683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8268186-4487-4ce6-81f2-443503ce4f3c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:56.377317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:56.377317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:56.377317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:56.377317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:56.417772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:56.419981 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:56.440756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1221/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:05:57.367270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:57.368751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:57.427067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad1b1-55f2-4c61-aec3-431bc703790b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:57.443706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:57.445302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:57.445764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:57.446416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] PATH_INFO: `/v3/projects/62b9cd35ca0649b7b4add7dac1e091fb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:57.448208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b9cd35ca0649b7b4add7dac1e091fb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:57.460505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:57.562901 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b9cd35ca0649b7b4add7dac1e091fb', 'request_id': 'req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.592750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b9cd35ca0649b7b4add7dac1e091fb', 'request_id': 'req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.608180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b9cd35ca0649b7b4add7dac1e091fb', 'request_id': 'req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.626779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] The token cache is being invalidate because project 62b9cd35ca0649b7b4add7dac1e091fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:57.627289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.629212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.634794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1247/2468] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:57 2022] DELETE /identity/v3/projects/62b9cd35ca0649b7b4add7dac1e091fb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:57.636394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:57.646796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d61a06-3ae8-4a2b-96b1-4fb7a961323e service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:57.786809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:57.792720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:57.793165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:57.793552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] PATH_INFO: `/v3/users/c24d0d24f6d641f28ce63c89c6682fb2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:57.795530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24d0d24f6d641f28ce63c89c6682fb2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:57.797307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:57.867696 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24d0d24f6d641f28ce63c89c6682fb2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.892993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24d0d24f6d641f28ce63c89c6682fb2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.916312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24d0d24f6d641f28ce63c89c6682fb2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.925830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24d0d24f6d641f28ce63c89c6682fb2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.926865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24d0d24f6d641f28ce63c89c6682fb2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:57.946842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1222/2469] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:57 2022] DELETE /identity/v3/users/c24d0d24f6d641f28ce63c89c6682fb2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:58.019108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:58.020873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.046224 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce93c9b-3c4e-415d-aa25-a2f3a13bba5a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:58.107226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:58.160040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:58.160957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.161358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.161705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] PATH_INFO: `/v3/users/05e1bcfc943d49c588dc050de517a465` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.167442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e1bcfc943d49c588dc050de517a465)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:58.169801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:58.236803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e1bcfc943d49c588dc050de517a465'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.237493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e1bcfc943d49c588dc050de517a465'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.238133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e1bcfc943d49c588dc050de517a465'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.260483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e1bcfc943d49c588dc050de517a465'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.270442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-92d65b4b-5830-42cd-9ba6-ae709cf8742f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e1bcfc943d49c588dc050de517a465'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.303605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1248/2470] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:05:58 2022] DELETE /identity/v3/users/05e1bcfc943d49c588dc050de517a465 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:58.336778 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:58.338761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.358899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f267-1e9b-41a9-b5be-d225dfe7522e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:58.450042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:58.483895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:58.485075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.485528 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.485974 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] PATH_INFO: `/v3/projects/3d74ecedd88c4411819074107b963161` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.487397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d74ecedd88c4411819074107b963161)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:58.489506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:58.572925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d74ecedd88c4411819074107b963161', 'request_id': 'req-49146178-753c-44c9-9324-f714db2de33c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.592111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d74ecedd88c4411819074107b963161', 'request_id': 'req-49146178-753c-44c9-9324-f714db2de33c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.611384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d74ecedd88c4411819074107b963161', 'request_id': 'req-49146178-753c-44c9-9324-f714db2de33c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.627375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] The token cache is being invalidate because project 3d74ecedd88c4411819074107b963161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:58.627733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.628394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.630049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1223/2471] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:58 2022] DELETE /identity/v3/projects/3d74ecedd88c4411819074107b963161 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:58.635205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2379-07cb-4e57-94fb-ddc8a5e7e7a6 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.635687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2379-07cb-4e57-94fb-ddc8a5e7e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.635812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2379-07cb-4e57-94fb-ddc8a5e7e7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.643729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:58.650961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.674604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8bfc2379-07cb-4e57-94fb-ddc8a5e7e7a6 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:58.676137 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8bfc2379-07cb-4e57-94fb-ddc8a5e7e7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.765928 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1249/2472] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:58.774497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.774787 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.775070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.779936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146178-753c-44c9-9324-f714db2de33c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:58.785535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:58.786476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.786806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.787095 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] PATH_INFO: `/v3/projects/07bc8db6fcd3437abcd8f7c6c01422c4` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.789259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bc8db6fcd3437abcd8f7c6c01422c4)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:58.791537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:58.801075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:58.804313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.819708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1250/2473] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:58.820654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:58.835071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ca8c-36b4-454a-a402-ce0729d21358 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:58.839588 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:58.840437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.840726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.841009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.841778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:05:58.842092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:58.843745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:58.858134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bc8db6fcd3437abcd8f7c6c01422c4', 'request_id': 'req-33e0a1ac-64c9-40d2-b230-b5080c17aa05'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.865175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1251/2474] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:05:58.870154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:58.877165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bc8db6fcd3437abcd8f7c6c01422c4', 'request_id': 'req-33e0a1ac-64c9-40d2-b230-b5080c17aa05'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.885052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bedac-8638-4694-95ef-77c5f0ef736c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:58.891726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bc8db6fcd3437abcd8f7c6c01422c4', 'request_id': 'req-33e0a1ac-64c9-40d2-b230-b5080c17aa05'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.913639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] The token cache is being invalidate because project 07bc8db6fcd3437abcd8f7c6c01422c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:05:58.914039 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.914820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-33e0a1ac-64c9-40d2-b230-b5080c17aa05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:05:58.917163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1224/2475] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:05:58 2022] DELETE /identity/v3/projects/07bc8db6fcd3437abcd8f7c6c01422c4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:58.921873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5bcab-9ad5-4fed-9b01-8715dc6ae441 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.922291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5bcab-9ad5-4fed-9b01-8715dc6ae441 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.922622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5bcab-9ad5-4fed-9b01-8715dc6ae441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.934452 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:58.946619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-8cf5bcab-9ad5-4fed-9b01-8715dc6ae441 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:58.947968 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8cf5bcab-9ad5-4fed-9b01-8715dc6ae441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:58.954817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:58.978124 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:58.979878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:58.980322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:58.981043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:58.981814 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:58.984190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.028366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1252/2476] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:58 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:59.029503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.031144 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:59.051994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1225/2477] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:59.060046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.060414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.060759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.088163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:59.089339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:59.149306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814efd2-c917-4635-93ca-cf58bd75a789 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.154752 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.155492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.155803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.156087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.156815 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.164066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.180479 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1226/2478] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:05:59.185058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.196405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1253/2479] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:59.200939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.210392 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163953c-8abd-4ea9-8be5-f6545f73d5d1 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.222710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7341-3b84-4765-b3a4-7b3d76506bd8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.225704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.226807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.227265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.227803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.228254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.228473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.228763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.229046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.230239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.231036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:05:59.231943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.232400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.235619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.248404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1254/2480] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:59.249340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.260590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff5ee-2ac3-487f-8046-aac88081a205 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.269477 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1227/2481] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:05:59.270835 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.275561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.276256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.276546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.276826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.277713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.279599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.285115 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9550751-3e37-43ee-b968-d2ae22a74db3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.290780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.291452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.291739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.292021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.292920 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.294907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.297615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1255/2482] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:59.302326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.321626 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a95f-bb71-4d1f-ad06-3a9938eec1ed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.335949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.337214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.337557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.337924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] PATH_INFO: `/v3/projects/0bdad8a334ed421287705b90828c47d0/users/397970975a194bb0b163eddd756119d5/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.345195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1228/2483] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:59.345369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.358762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdad8a334ed421287705b90828c47d0, user_id=397970975a194bb0b163eddd756119d5, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.361758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973ed5-a114-48d0-91ee-3a2146ddcee2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.379791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1256/2484] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:59 2022] PUT /identity/v3/projects/0bdad8a334ed421287705b90828c47d0/users/397970975a194bb0b163eddd756119d5/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:05:59.392205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.392205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.392520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.433003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] MFA Rules not processed for user `397970975a194bb0b163eddd756119d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:59.434786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:59.506627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275be46-6597-4a13-9dcc-ed6503a2ae55 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.551661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:59.564898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:05:59.580638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1257/2485] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:59.585172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.607108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.607712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.607996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.608268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.608956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.611272 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.618611 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed15782-24db-4922-9a68-650acc9781f4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.623725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.624499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.624844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.625155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.625932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.628302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.637790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1229/2486] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:05:59.638941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.650018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f7937-b180-4b8b-b631-1a4d73fb52e8 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.655668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.656387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.656821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.657109 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.658087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.659923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.665564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1258/2487] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:05:59.669936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.675718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1230/2488] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:05:59.679682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.697931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfcd50-e35e-4503-8916-a4c0c17fa9bc admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.786245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656d5c-b41b-4b30-b115-ff04d21177e0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.792134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.792824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.793169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.793387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.794143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.794538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.795640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.795983 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.796456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.796945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.797960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.800819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.808937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1231/2489] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:05:59.813421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.832325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72d03-7842-4858-ad25-b14736f066ec admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.838533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.839499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1259/2490] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:05:59.839889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.840308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.840771 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] PATH_INFO: `/v3/projects/ee731ccd59c14c9b988df59ace39ad5a/users/159bc593a50b4c4eb2150a18b7b76b4b/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.843544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.854644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f865d6-f730-46f8-9387-a0135b6b8325 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.859382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee731ccd59c14c9b988df59ace39ad5a, user_id=159bc593a50b4c4eb2150a18b7b76b4b, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.860108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.860771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.861057 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.861331 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.861990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b451ab-f721-4e7c-856c-a6a61c7c44ed admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.862763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.864363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:05:59.887286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1232/2491] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:59 2022] PUT /identity/v3/projects/ee731ccd59c14c9b988df59ace39ad5a/users/159bc593a50b4c4eb2150a18b7b76b4b/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:05:59.891094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.891441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.891791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.894485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1260/2492] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:05:59.895751 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.911027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e93eb-18e4-4b6b-b803-1f639f939738 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:05:59.921947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] MFA Rules not processed for user `159bc593a50b4c4eb2150a18b7b76b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:05:59.923411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:05:59.979807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:05:59.980720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:05:59.981007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:05:59.981285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] PATH_INFO: `/v3/projects/a28ae4fa605f4b019cda99672e7d873b/users/9ea870fba7644ee299148424298be406/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:05:59.995092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1233/2493] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:05:59.996685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28ae4fa605f4b019cda99672e7d873b, user_id=9ea870fba7644ee299148424298be406, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:05:59.999510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:05:59.999694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.008522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:00.014622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eceac-b42f-4325-a329-be32b03d0f7a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.024141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1261/2494] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:05:59 2022] PUT /identity/v3/projects/a28ae4fa605f4b019cda99672e7d873b/users/9ea870fba7644ee299148424298be406/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:00.028547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.065654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:00.088243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.089050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.089344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.089630 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.090355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.092263 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.098891 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d164d6-0955-44bd-adf6-5bda765e05ed admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.104845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.105563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.105845 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.106154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.106885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.108488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.124548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1262/2495] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:00.124726 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1234/2496] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:05:59 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:00.126132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.126340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.138481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bababc-c739-4314-82b1-90df0915cef9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.193840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599a858-8013-4b72-9469-70b35be0d035 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.196760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.197741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.198105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.198480 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] PATH_INFO: `/v3/projects/a28ae4fa605f4b019cda99672e7d873b/users/9ea870fba7644ee299148424298be406/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.198598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.199196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.199480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.199756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.200442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.200931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28ae4fa605f4b019cda99672e7d873b, user_id=9ea870fba7644ee299148424298be406, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.202382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eada5e-3184-4723-8d06-f959f2dfae67 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.203789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.216559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1263/2497] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:00 2022] PUT /identity/v3/projects/a28ae4fa605f4b019cda99672e7d873b/users/9ea870fba7644ee299148424298be406/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:00.226166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1235/2498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:00 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:00.226849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.227307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.227597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.227876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.254190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] MFA Rules not processed for user `9ea870fba7644ee299148424298be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:00.255394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:00.292791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5984a-f999-4c41-b14a-b4bdf2e8f00c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.297509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.298238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.298522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.298803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.299686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.301303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.312844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1264/2499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:00.317088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.328201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab23ad-1900-40b1-b8c3-1fbb02a6e265 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.328926 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1236/2500] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:00.332911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.333796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.334463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.335162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] PATH_INFO: `/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e/users/9e578bb6389f46d08772f8b4fb272e74/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.340496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.341873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:00.348410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:00.352734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34da6fdd414b38a4dbfc9a07a0480e, user_id=9e578bb6389f46d08772f8b4fb272e74, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.356870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.373228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1265/2501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:00 2022] PUT /identity/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e/users/9e578bb6389f46d08772f8b4fb272e74/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:00.379223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.423256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b826-f6c8-48d6-8755-5e88370aaca9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.426409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:00.458366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba92fc1-6952-4e1c-aba9-5c1c40c6adc9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.464094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.464767 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.465056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.465973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.466435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.469149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.486941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1266/2502] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:00.491938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.499878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.500546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.500836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.501118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.504094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64275e-af5d-4e14-8bbd-eb56e119aa4e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.511310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.512739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.513123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.513475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] PATH_INFO: `/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e/users/9e578bb6389f46d08772f8b4fb272e74/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.516416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34da6fdd414b38a4dbfc9a07a0480e, user_id=9e578bb6389f46d08772f8b4fb272e74, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.519620 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170892b-da55-4373-9ba3-da4455e565e7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.539520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1267/2503] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:00 2022] PUT /identity/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e/users/9e578bb6389f46d08772f8b4fb272e74/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:00.551675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.552218 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.553242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.570952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.572399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.581435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] MFA Rules not processed for user `9e578bb6389f46d08772f8b4fb272e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:00.582306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1237/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:00.582948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:00.659410 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1268/2505] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:00.671111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.680956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6cf0a-2452-4c3f-90e6-8d3f7c0f4ef0 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.733941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.734885 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.735170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.735450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.746478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.747891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.758668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1238/2506] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:00.838660 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.848764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82fa2c-0183-451f-a56a-168c4dded575 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:00.853374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:00.854028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:00.854609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:00.854916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:00.914713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:00.916422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c341d67-f0e7-44e0-8c1c-9fc265841131 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:00.928657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1269/2507] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:00.943785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:00.958595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:01.022389 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e63cf0-585f-4be6-8a68-9ca175803ba2 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:01.028003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0373-d637-4396-b455-b23233290383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:01.028906 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0373-d637-4396-b455-b23233290383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:01.029258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0373-d637-4396-b455-b23233290383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:01.029540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0373-d637-4396-b455-b23233290383 admin admin] PATH_INFO: `/v3/users/397970975a194bb0b163eddd756119d5` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:01.030791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0373-d637-4396-b455-b23233290383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397970975a194bb0b163eddd756119d5)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:01.032706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0373-d637-4396-b455-b23233290383 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:01.089130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397970975a194bb0b163eddd756119d5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.101636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397970975a194bb0b163eddd756119d5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.109330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397970975a194bb0b163eddd756119d5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.117412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397970975a194bb0b163eddd756119d5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.118132 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397970975a194bb0b163eddd756119d5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.124286 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1239/2508] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:00 2022] DELETE /identity/v3/users/397970975a194bb0b163eddd756119d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:01.128915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:01.129307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:01.129653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:01.146706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:01.148090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:01.186366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:01.207596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1270/2509] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:01.218101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:01.219514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:01.278646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0373-d637-4396-b455-b23233290383 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:01.282330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:01.282979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:01.283289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:01.283563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:01.293322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:01.294774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:01.304300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1240/2510] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:01.571947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:01.573854 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:01.592929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7fb6a-49a7-407f-9650-485eb21be2f9 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:01.599897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:01.600765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:01.601058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:01.601337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] PATH_INFO: `/v3/projects/0bdad8a334ed421287705b90828c47d0` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:01.602603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdad8a334ed421287705b90828c47d0)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:01.605563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:01.657567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdad8a334ed421287705b90828c47d0', 'request_id': 'req-f316dd77-c52e-4c42-baa1-de0d3667c62a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.663734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdad8a334ed421287705b90828c47d0', 'request_id': 'req-f316dd77-c52e-4c42-baa1-de0d3667c62a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.672356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdad8a334ed421287705b90828c47d0', 'request_id': 'req-f316dd77-c52e-4c42-baa1-de0d3667c62a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.691440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] The token cache is being invalidate because project 0bdad8a334ed421287705b90828c47d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:01.691739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.692613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.694740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1271/2511] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:01 2022] DELETE /identity/v3/projects/0bdad8a334ed421287705b90828c47d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:01.699204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:01.717604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca224-05ae-4244-9a95-367ada882bdd service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:01.750892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:01.778592 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:01.779462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:01.779740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:01.780014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] PATH_INFO: `/v3/users/9ea870fba7644ee299148424298be406` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:01.781171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea870fba7644ee299148424298be406)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:01.783145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:01.829227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea870fba7644ee299148424298be406'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.841602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea870fba7644ee299148424298be406'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.848695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea870fba7644ee299148424298be406'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.855993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea870fba7644ee299148424298be406'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.856692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-29afd4d0-a81f-43be-8fc1-4621833fb245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea870fba7644ee299148424298be406'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:01.862561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1241/2512] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:01 2022] DELETE /identity/v3/users/9ea870fba7644ee299148424298be406 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:02.143931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.145988 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:02.160642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316dd77-c52e-4c42-baa1-de0d3667c62a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.222590 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.223564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.223881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.224161 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] PATH_INFO: `/v3/projects/a28ae4fa605f4b019cda99672e7d873b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.225880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28ae4fa605f4b019cda99672e7d873b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.228200 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.278261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28ae4fa605f4b019cda99672e7d873b', 'request_id': 'req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:02.284632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28ae4fa605f4b019cda99672e7d873b', 'request_id': 'req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:02.292550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28ae4fa605f4b019cda99672e7d873b', 'request_id': 'req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:02.294543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:02.306722 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] The token cache is being invalidate because project a28ae4fa605f4b019cda99672e7d873b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:02.307103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:02.307930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ffe7f5dc-11d0-4da6-bd09-a3cf40b6aa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:02.309878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1272/2513] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:02 2022] DELETE /identity/v3/projects/a28ae4fa605f4b019cda99672e7d873b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:02.315100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.315430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.315784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.336699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:02.338173 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:02.416018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1242/2514] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:02.423689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.424188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.424603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.446007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:02.447205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:02.456880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1273/2515] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:02.462598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.473691 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6cff-5bb0-4763-b189-f8c5baebe371 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.481423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.482247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.482623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.483001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.483937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:02.484335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.486028 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.500090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1243/2516] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:02.504462 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.514712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020465ae-fcb6-433c-8b97-08f850f81606 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.519249 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.519889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.520171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.520444 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.521133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.524150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.550264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1274/2517] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:02 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:02.555871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.565712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd93e1-4d81-4129-abd6-dd935e6ab8d7 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.607224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:02.626871 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.627539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.627827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.628100 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.628780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.631334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.651407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1244/2518] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:02 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:02.656163 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.667257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541750e1-73df-4881-afab-70d32bd619a8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.672162 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.672823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.673110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.673390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.674129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.675759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.687336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1275/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:02.691570 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.703053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c3ba-b33e-494a-ab6d-a0fbd37ebd3f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.707780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.708438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.708725 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.709594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.710462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.712056 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e1c8d-c4a2-414f-8a38-1313b1079326 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.725887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1245/2520] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:02.727769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.737996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afcd0b-d7da-45fe-847d-9099c743fc64 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.743505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.744391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.744678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.744956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] PATH_INFO: `/v3/projects/dc27756f3a5f489d9365865e2b855f83/users/fddb0a9b9cc44cb6b9bb655b48edb1c8/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.760703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc27756f3a5f489d9365865e2b855f83, user_id=fddb0a9b9cc44cb6b9bb655b48edb1c8, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.763413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.778844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1276/2521] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:02 2022] PUT /identity/v3/projects/dc27756f3a5f489d9365865e2b855f83/users/fddb0a9b9cc44cb6b9bb655b48edb1c8/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:02.789169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.789458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.789733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.818383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] MFA Rules not processed for user `fddb0a9b9cc44cb6b9bb655b48edb1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:02.820467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:02.894910 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1246/2522] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:02.906310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:02.908015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:02.967892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef47c9-bd5a-4ff3-b87f-a2fa190b2443 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:02.971574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:02.972242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:02.972528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:02.972803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:02.983365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:02.984861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536260cd-0606-4ba7-8286-1ff003ac857e service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:02.996172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1277/2523] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:03.017092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:03.080565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24262b2a-6e13-424c-9da1-c0dae1b4645a None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:03.085410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:03.086322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:03.086724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:03.087011 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] PATH_INFO: `/v3/users/fddb0a9b9cc44cb6b9bb655b48edb1c8` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:03.088220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddb0a9b9cc44cb6b9bb655b48edb1c8)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:03.090166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:03.136916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddb0a9b9cc44cb6b9bb655b48edb1c8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.141353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:03.151731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddb0a9b9cc44cb6b9bb655b48edb1c8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.158826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddb0a9b9cc44cb6b9bb655b48edb1c8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.166203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddb0a9b9cc44cb6b9bb655b48edb1c8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.166869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddb0a9b9cc44cb6b9bb655b48edb1c8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.172767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1247/2524] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:03 2022] DELETE /identity/v3/users/fddb0a9b9cc44cb6b9bb655b48edb1c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:03.177423 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:03.178320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:03.178614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:03.196488 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:03.197697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:03.260385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1278/2525] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:03.270882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:03.272986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:03.336740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01d453-8537-4d7c-98d2-6a57637e7cd4 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:03.340435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:03.341087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:03.341369 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:03.341648 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:03.350913 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:03.352337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec20b3-22c1-4f7d-846c-da14aea3cbe1 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:03.361998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1248/2526] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:03.874005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:03.875600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:03.895514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda84ecf-e686-4ce8-bce9-b94b05907630 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:03.903790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:03.904887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:03.905129 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:03.905831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] PATH_INFO: `/v3/projects/dc27756f3a5f489d9365865e2b855f83` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:03.907380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc27756f3a5f489d9365865e2b855f83)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:03.909606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:03.948367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:03.963979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc27756f3a5f489d9365865e2b855f83', 'request_id': 'req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.969627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc27756f3a5f489d9365865e2b855f83', 'request_id': 'req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.977311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc27756f3a5f489d9365865e2b855f83', 'request_id': 'req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.989379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] The token cache is being invalidate because project dc27756f3a5f489d9365865e2b855f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:03.989691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.990344 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-2d4d09e3-f6cf-43b0-88c0-b47b059b2642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:03.991908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1279/2527] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:03 2022] DELETE /identity/v3/projects/dc27756f3a5f489d9365865e2b855f83 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:03.996786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:03.997258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:03.997360 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.015971 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:04.017104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:04.079161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1249/2528] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:04.087349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.087670 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.087945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.106215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:04.107415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:04.115169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1280/2529] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:04.119229 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.128768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e1f7a-ca49-4eac-94e7-f48e368fce50 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.133989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.134672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.134958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.135234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.135958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:04.136262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.137841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.150481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1250/2530] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:04.154734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.164407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b885d0-962e-4c0b-b034-b1c9141dbcff None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.169103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.169765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.170058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.170375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.171065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.173036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.198962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1281/2531] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:04 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:04.202927 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.213603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee9cf-f8bd-4958-82e6-c1b4460816a5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.269556 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.270226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.270536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.270788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.271628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.273516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.280112 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:04.294399 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1251/2532] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:04 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:04.298501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.309239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8163b95-ce7f-4b3f-a3af-c4d09f2bfeab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.313931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.314651 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.314932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.315211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.315943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.317539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.329636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1282/2533] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:04.333577 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.343645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21335-3e83-4497-bd9a-d5e01c681625 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.348273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.348911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.349192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.349705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.350455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.352027 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e10391-f247-4943-a5a8-3c0eee30c296 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.362349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1252/2534] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:04.367023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.376851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ba3b-dc5f-4fa1-832c-01fa171bbffa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.382442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.383328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.383615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.383894 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] PATH_INFO: `/v3/projects/bce3df52ef054a17bface27aac7b1815/users/cb2700411711445b859801ea22f52d84/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.398421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce3df52ef054a17bface27aac7b1815, user_id=cb2700411711445b859801ea22f52d84, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.401173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.415214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1283/2535] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:04 2022] PUT /identity/v3/projects/bce3df52ef054a17bface27aac7b1815/users/cb2700411711445b859801ea22f52d84/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:04.426223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c9deb-d875-4dee-8010-af954bd7b8e2 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.426513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c9deb-d875-4dee-8010-af954bd7b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.426868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c9deb-d875-4dee-8010-af954bd7b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.454585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-da9c9deb-d875-4dee-8010-af954bd7b8e2 None None] MFA Rules not processed for user `cb2700411711445b859801ea22f52d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:04.455846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da9c9deb-d875-4dee-8010-af954bd7b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:04.520359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1253/2536] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:04.531393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:04.533079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:04.620430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6e08-8001-4f34-9739-5b5206af76b7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:04.626508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58212e67bed45fc9c573568eea16b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:04.627225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:04.627509 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:04.627781 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:04.638155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:04.639612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:04.651680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1284/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:06.399829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:06.400238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:06.400411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:06.431325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:06.432668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:06.510544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1254/2538] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:06.517546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:06.519087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:06.587630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:06.608046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618adff0-5ce1-45e8-934a-22fe8d62206e service glance] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:06.612957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:06.613597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:06.613940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:06.614251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:06.623068 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:06.624689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e7a07-e413-4bd7-b011-d3dc0cb1e392 service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:06.633842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1285/2539] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 13:06:07.896965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:07.899114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:07.970444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620ead3-de7e-4db7-ac4a-d41c7b2e9e41 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:07.975020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:07.976169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:07.976416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:07.976695 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] PATH_INFO: `/v3/users/159bc593a50b4c4eb2150a18b7b76b4b` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:07.977953 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=159bc593a50b4c4eb2150a18b7b76b4b)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:07.980207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:07.994600 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:08.038195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159bc593a50b4c4eb2150a18b7b76b4b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.050436 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159bc593a50b4c4eb2150a18b7b76b4b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.058437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159bc593a50b4c4eb2150a18b7b76b4b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.065343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159bc593a50b4c4eb2150a18b7b76b4b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.065993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159bc593a50b4c4eb2150a18b7b76b4b'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.072877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1255/2540] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:07 2022] DELETE /identity/v3/users/159bc593a50b4c4eb2150a18b7b76b4b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:08.077449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:08.077879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:08.078012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:08.097031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:08.098342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:08.160825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1286/2541] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:08.171545 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:08.173083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:08.234780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef536441-b58f-4fe7-a524-4cc5d944aa3f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:08.238511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:08.239179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:08.239460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:08.239753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:08.249329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:08.250856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:08.263580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1256/2542] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:08.538920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:08.540664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:08.573889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf8f3-7641-41c6-a849-499cf7a06f12 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:08.579251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:08.580210 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:08.580585 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:08.580976 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] PATH_INFO: `/v3/projects/ee731ccd59c14c9b988df59ace39ad5a` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:08.582205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee731ccd59c14c9b988df59ace39ad5a)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:08.584180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:08.638826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee731ccd59c14c9b988df59ace39ad5a', 'request_id': 'req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.644433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee731ccd59c14c9b988df59ace39ad5a', 'request_id': 'req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.651543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee731ccd59c14c9b988df59ace39ad5a', 'request_id': 'req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.663613 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] The token cache is being invalidate because project ee731ccd59c14c9b988df59ace39ad5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:08.663910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.664527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.666394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1287/2543] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:08 2022] DELETE /identity/v3/projects/ee731ccd59c14c9b988df59ace39ad5a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:08.670546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:08.682101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d5181-649e-4ba9-9356-8b8e97df5473 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:08.741446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:08.742354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:08.742747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:08.743029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] PATH_INFO: `/v3/users/9e578bb6389f46d08772f8b4fb272e74` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:08.744228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e578bb6389f46d08772f8b4fb272e74)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:08.746179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:08.783606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:08.794764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e578bb6389f46d08772f8b4fb272e74'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.808735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e578bb6389f46d08772f8b4fb272e74'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.816255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e578bb6389f46d08772f8b4fb272e74'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.823697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e578bb6389f46d08772f8b4fb272e74'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.824366 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-20679bec-306d-4fd0-bfcc-8e904bf8a72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e578bb6389f46d08772f8b4fb272e74'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:08.830301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1257/2544] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:08 2022] DELETE /identity/v3/users/9e578bb6389f46d08772f8b4fb272e74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:09.111438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.112859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:09.126127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bf1c-6642-4a1a-9705-7d94d8c9d8f7 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.187253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.188117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.188400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.188676 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] PATH_INFO: `/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.189879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae34da6fdd414b38a4dbfc9a07a0480e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.191840 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.203522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:09.241725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae34da6fdd414b38a4dbfc9a07a0480e', 'request_id': 'req-0b3521a9-4a58-40c7-8516-1ccd7f33631d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:09.247425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae34da6fdd414b38a4dbfc9a07a0480e', 'request_id': 'req-0b3521a9-4a58-40c7-8516-1ccd7f33631d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:09.254892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae34da6fdd414b38a4dbfc9a07a0480e', 'request_id': 'req-0b3521a9-4a58-40c7-8516-1ccd7f33631d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:09.268158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] The token cache is being invalidate because project ae34da6fdd414b38a4dbfc9a07a0480e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:09.268449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:09.269225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0b3521a9-4a58-40c7-8516-1ccd7f33631d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:09.270934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1288/2545] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:09 2022] DELETE /identity/v3/projects/ae34da6fdd414b38a4dbfc9a07a0480e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:09.276816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.277308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.277458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.295514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:09.296763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:09.359120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1258/2546] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:09.367338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.367992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.367992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.392663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:09.393895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:09.402451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1289/2547] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:09.410742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.421379 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff232d7-2ed5-4456-95f2-f06379eb9591 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.426077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.426777 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.427059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.427336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.428098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:09.428919 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.430651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.442633 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1259/2548] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:09.447659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.456945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3fef2-f05e-401b-8462-9bfd27013bed None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.461788 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.462454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.462739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.463015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.463706 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.465625 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.492817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1290/2549] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:09.496793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.507552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0023f-1ec6-4c50-96d6-7f5660c24258 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.565794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.566551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.566894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.567225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.567950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.570727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.590779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1260/2550] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:09.595225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.607838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ef7e1-4824-47bb-b95c-c688dd26e943 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.612616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.613290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.613579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.613857 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.614629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.616972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.628416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1291/2551] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:09.633347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.643338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f680fd-ac84-4cb0-8621-9f1c5185344d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.648106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.648759 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.649046 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.649318 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.650047 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.651676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb13a9-8875-4f85-bca4-5b711eb0281b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.661826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1261/2552] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:09.665978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.678971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3982b-c9f9-4d6f-9ee8-2df96e3d5de8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.683726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.684614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.684895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.685170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] PATH_INFO: `/v3/projects/346c29b0ee7d47f7b7698cb9bec18609/users/775c22d03aab4776b3a22d29630d9d2b/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.701333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346c29b0ee7d47f7b7698cb9bec18609, user_id=775c22d03aab4776b3a22d29630d9d2b, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.704013 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.716990 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1292/2553] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:09 2022] PUT /identity/v3/projects/346c29b0ee7d47f7b7698cb9bec18609/users/775c22d03aab4776b3a22d29630d9d2b/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:09.729171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.729456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.729730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.760092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] MFA Rules not processed for user `775c22d03aab4776b3a22d29630d9d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:09.761213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:09.769290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:09.831331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1262/2554] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:09.835823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.900580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05d70-462b-4447-9cc3-9c2d66c9a089 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:09.905184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:09.905833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:09.906133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:09.906413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:09.907096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:09.909020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:09.940199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1293/2555] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:09.941368 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:09.952289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c47f-7e67-4728-b5e1-c9418d88287f None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.010624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.011209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.011489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.011761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.012481 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.014448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.034365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1263/2556] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:09 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:10.038898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.049333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cae2a-3360-47e6-834d-e358dddb84f3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.054806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.055594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.055879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.056157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.057105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.059192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.071634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1294/2557] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:10.075729 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.085942 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a928204-31c6-4de5-8f83-2c831794d910 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.090649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.091529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.091813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.092091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] PATH_INFO: `/v3/projects/1b5d48e5695649178c4d71751366f4c0/users/0cbaf0fef6b44324958c0be5c529e305/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.108486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5d48e5695649178c4d71751366f4c0, user_id=0cbaf0fef6b44324958c0be5c529e305, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.111171 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.124744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1264/2558] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:10 2022] PUT /identity/v3/projects/1b5d48e5695649178c4d71751366f4c0/users/0cbaf0fef6b44324958c0be5c529e305/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:10.128978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.139874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e514-3ea4-495d-ab06-79382a3f1178 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.147473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:10.198764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.199436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.199720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.199996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.200719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.202358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0ed7-810d-49bd-88b1-9d985b99f979 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.213087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1295/2559] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:10.217098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.227653 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86f73-bcc8-4120-8867-d5c4986792a5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.232456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.233354 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.233635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.233908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] PATH_INFO: `/v3/projects/1b5d48e5695649178c4d71751366f4c0/users/0cbaf0fef6b44324958c0be5c529e305/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.235849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5d48e5695649178c4d71751366f4c0, user_id=0cbaf0fef6b44324958c0be5c529e305, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.238585 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.249341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1265/2560] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:10 2022] PUT /identity/v3/projects/1b5d48e5695649178c4d71751366f4c0/users/0cbaf0fef6b44324958c0be5c529e305/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:10.259941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.260237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.260521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.289325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] MFA Rules not processed for user `0cbaf0fef6b44324958c0be5c529e305`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:10.290574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:10.358949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1296/2561] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:10.370615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.372329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:10.432008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0b295-a6d9-4259-9f5c-94cda313955e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.435713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.436375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.436657 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.436931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.447050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.448471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1bab9-19bd-4bfe-b6a4-887825519c1c service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.461831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1266/2562] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:10.870656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:10.939185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f31f3-cc00-43cc-98c6-ab66194d1b1f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:10.943717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:10.945025 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:10.945305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:10.945582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] PATH_INFO: `/v3/users/775c22d03aab4776b3a22d29630d9d2b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:10.946818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=775c22d03aab4776b3a22d29630d9d2b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:10.948742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:10.989115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:10.999937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775c22d03aab4776b3a22d29630d9d2b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.000577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775c22d03aab4776b3a22d29630d9d2b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.001172 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775c22d03aab4776b3a22d29630d9d2b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.014466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775c22d03aab4776b3a22d29630d9d2b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.021237 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775c22d03aab4776b3a22d29630d9d2b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.034849 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1297/2563] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:10 2022] DELETE /identity/v3/users/775c22d03aab4776b3a22d29630d9d2b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:11.040259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:11.040571 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:11.040850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:11.048588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:11.062148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:11.063298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:11.125763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1267/2564] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:11.135437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:11.136846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:11.196180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b542f-7249-42e0-ba6d-742822ffa40b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:11.199874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:11.200517 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:11.200801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:11.201080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:11.210514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:11.211947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:11.221234 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1298/2565] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:11.514815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:11.517023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:11.529866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20248-c77b-447e-b6f0-b2fa08504160 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:11.534663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:11.535529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:11.535811 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:11.536087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] PATH_INFO: `/v3/projects/346c29b0ee7d47f7b7698cb9bec18609` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:11.537278 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=346c29b0ee7d47f7b7698cb9bec18609)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:11.539773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:11.587739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346c29b0ee7d47f7b7698cb9bec18609', 'request_id': 'req-f74526c6-8429-4a35-b244-081cad23c73c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.593668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346c29b0ee7d47f7b7698cb9bec18609', 'request_id': 'req-f74526c6-8429-4a35-b244-081cad23c73c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.601955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346c29b0ee7d47f7b7698cb9bec18609', 'request_id': 'req-f74526c6-8429-4a35-b244-081cad23c73c'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.615203 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] The token cache is being invalidate because project 346c29b0ee7d47f7b7698cb9bec18609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:11.615532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.617193 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.618996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1268/2566] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:11 2022] DELETE /identity/v3/projects/346c29b0ee7d47f7b7698cb9bec18609 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:11.623125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:11.632691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663170a-4e09-4fce-8f27-8ef02300bdfb service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:11.690924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:11.691803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:11.692089 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:11.692370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] PATH_INFO: `/v3/users/0cbaf0fef6b44324958c0be5c529e305` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:11.693550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbaf0fef6b44324958c0be5c529e305)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:11.695617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:11.749583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbaf0fef6b44324958c0be5c529e305'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.750285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbaf0fef6b44324958c0be5c529e305'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.750899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbaf0fef6b44324958c0be5c529e305'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.758390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:11.765583 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbaf0fef6b44324958c0be5c529e305'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.773716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1e0a3827-cfdb-4415-97de-ef736cc8f705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbaf0fef6b44324958c0be5c529e305'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:11.790334 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1299/2567] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:11 2022] DELETE /identity/v3/users/0cbaf0fef6b44324958c0be5c529e305 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:12.069722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.071248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:12.090554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74526c6-8429-4a35-b244-081cad23c73c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.150827 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.151610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.151888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.152161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] PATH_INFO: `/v3/projects/1b5d48e5695649178c4d71751366f4c0` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.153327 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5d48e5695649178c4d71751366f4c0)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.155254 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.189487 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:12.205794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5d48e5695649178c4d71751366f4c0', 'request_id': 'req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:12.212804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5d48e5695649178c4d71751366f4c0', 'request_id': 'req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:12.220060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5d48e5695649178c4d71751366f4c0', 'request_id': 'req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:12.235702 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] The token cache is being invalidate because project 1b5d48e5695649178c4d71751366f4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:12.235994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:12.236655 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a65c3338-8604-4f2b-a3f6-8ca3c293ca0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:12.238211 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1269/2568] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:12 2022] DELETE /identity/v3/projects/1b5d48e5695649178c4d71751366f4c0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:12.243453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.243922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.244087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.262947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:12.264241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:12.329799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1300/2569] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:12.340268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.340558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.340842 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.365627 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:12.366938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:12.379796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1270/2570] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:12.384698 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.394440 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc6e40-7582-4bbf-aadf-86a22017d61f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.400424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.401175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.401400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.401679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.402458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:12.402775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.404406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.417318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1301/2571] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:12.421859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.433849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1850de-cebd-43fa-8259-0b768c868356 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.438794 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.439599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.439889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.440180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.440859 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.443297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.476220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1271/2572] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:12.477719 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.491497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9856-6dfe-4436-8969-14d88be08f9d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.560261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.560934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.561217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.561489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.562201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.564131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.590100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1302/2573] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:12.591331 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.604852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb8f6-96f9-4d00-b744-4e879165f685 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.609539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.610234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.610522 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.610802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.611535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.613134 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.624996 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1272/2574] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:12.629243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.640093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0f73-e423-4ef9-9c0a-9a0e38acdab1 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.644912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.645603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.645888 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.646229 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.646960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.648646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e6f12-01c9-45a3-9cb4-7401ddc7ac4c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.659766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1303/2575] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:12.663998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.674520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44fe-52be-43e4-a9a2-c74e44cadec7 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.680756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.681875 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.682192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.682478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] PATH_INFO: `/v3/projects/4d22e26a9e024cf1a51a71f27c35f8e6/users/ba66d8afa68f477cb88379c89711859d/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.700058 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d22e26a9e024cf1a51a71f27c35f8e6, user_id=ba66d8afa68f477cb88379c89711859d, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.702739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.715750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1273/2576] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:12 2022] PUT /identity/v3/projects/4d22e26a9e024cf1a51a71f27c35f8e6/users/ba66d8afa68f477cb88379c89711859d/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:12.727368 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.727848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.728183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.760972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] MFA Rules not processed for user `ba66d8afa68f477cb88379c89711859d`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:12.762323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:12.793239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:12.832559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1304/2577] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:12.837472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.903624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c2b3-4081-4c95-b1be-ac70ab6f2c39 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:12.910270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:12.910883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:12.911219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:12.911498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:12.912232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:12.914744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:12.940322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1274/2578] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:12.945736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:12.957181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9252090-ade7-4ccd-aabd-80a8e321539d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.021115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.021785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.022724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.023007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.023879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.025826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.046531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1305/2579] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:12 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:13.050452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.060943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767015a-b5bf-4f3b-8bf0-6f5906060858 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.065616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.066323 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.066609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.066888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.067612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.069739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.081023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1275/2580] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:13.086099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.096539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cc6b5-05d8-449e-835b-57bccf95f56b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.101451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.102366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.102650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.102953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] PATH_INFO: `/v3/projects/99f2df6187f043498882ee1c99ffd473/users/99522d63c4134371bacc443bfd9fd14e/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.118255 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f2df6187f043498882ee1c99ffd473, user_id=99522d63c4134371bacc443bfd9fd14e, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.120898 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.134771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1306/2581] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:13 2022] PUT /identity/v3/projects/99f2df6187f043498882ee1c99ffd473/users/99522d63c4134371bacc443bfd9fd14e/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:13.138728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.149419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bc8d2-e759-45e3-a17d-7626fa12374c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.176619 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:13.211105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.211793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.212082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.212358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.213091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.214728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ad7c-fd91-428b-926a-00ce2a556973 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.226402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1276/2582] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:13.230881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.241602 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c441-ca48-4e33-a07e-bb8f8e69b964 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.246349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.247223 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.247508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.247786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] PATH_INFO: `/v3/projects/99f2df6187f043498882ee1c99ffd473/users/99522d63c4134371bacc443bfd9fd14e/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.249742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f2df6187f043498882ee1c99ffd473, user_id=99522d63c4134371bacc443bfd9fd14e, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.252422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.264102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1307/2583] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:13 2022] PUT /identity/v3/projects/99f2df6187f043498882ee1c99ffd473/users/99522d63c4134371bacc443bfd9fd14e/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:13.276370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.276852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.278727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.309105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] MFA Rules not processed for user `99522d63c4134371bacc443bfd9fd14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:13.310334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:13.383506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1277/2584] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:13.394786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.396572 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:13.465027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198509-4d97-4462-95b6-3fa22c9a500e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.468652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.469299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.469580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.469856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.483757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.485244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.495692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1308/2585] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:13.575723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:13.586791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6c74-6289-40a6-967c-a4ec4ce290e3 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:13.592472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:13.593333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:13.593682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:13.593966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:13.659114 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:13.660543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df106-9a38-494c-a3b1-cfa907d4175f service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:13.670830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1278/2586] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:19.187072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:19.188518 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.217096 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:19.255764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f96a-3eaf-4214-ba20-2ff2ff1006af service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:19.260472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:19.261373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.261691 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.261998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] PATH_INFO: `/v3/users/cb2700411711445b859801ea22f52d84` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.263328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2700411711445b859801ea22f52d84)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:19.265531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:19.311554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2700411711445b859801ea22f52d84'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.312205 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2700411711445b859801ea22f52d84'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.312828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2700411711445b859801ea22f52d84'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.324678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2700411711445b859801ea22f52d84'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.331481 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2700411711445b859801ea22f52d84'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.344300 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1309/2587] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:19 2022] DELETE /identity/v3/users/cb2700411711445b859801ea22f52d84 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:19.348894 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.349396 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.349510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.367275 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:19.368475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.416918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:19.433155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1279/2588] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:19.442728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:19.444211 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.506609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168afa-ba67-425b-806a-74388dc2500e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:19.510701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:19.511359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.511644 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.511926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.521139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:19.523117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51cd1a-bd2d-466e-a1a4-a6560f7049c0 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:19.532624 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1310/2589] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:19.567555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:19.569806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.582719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85317edd-4443-4c91-b323-fe891de8de36 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:19.589029 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:19.589931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.590244 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.590645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] PATH_INFO: `/v3/users/ba66d8afa68f477cb88379c89711859d` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.591853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba66d8afa68f477cb88379c89711859d)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:19.594031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:19.643639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba66d8afa68f477cb88379c89711859d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.656147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba66d8afa68f477cb88379c89711859d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.664718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba66d8afa68f477cb88379c89711859d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.672832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba66d8afa68f477cb88379c89711859d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.673486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba66d8afa68f477cb88379c89711859d'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.680157 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1280/2590] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:19 2022] DELETE /identity/v3/users/ba66d8afa68f477cb88379c89711859d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:19.685047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.685345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.685630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.704028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:19.705283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.749421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:19.769208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1311/2591] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:19.778844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:19.780252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.812271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:19.813812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:19.827154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2edde-4bc0-4215-af0b-bf4e10aa71e1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:19.833596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:19.834701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.835571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.836024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] PATH_INFO: `/v3/projects/bce3df52ef054a17bface27aac7b1815` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.837421 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce3df52ef054a17bface27aac7b1815)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:19.840242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:19.846410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fb109-9b98-4702-8f44-e6404cbba4bf admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:19.851161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:19.851821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.852108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.852391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.862788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:19.864256 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ca62-5ed4-4ae3-9894-546703f9fde6 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:19.875497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1281/2592] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:19.894561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce3df52ef054a17bface27aac7b1815', 'request_id': 'req-a1dfb973-7a14-4fe1-a897-def7ef1045bc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.900607 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce3df52ef054a17bface27aac7b1815', 'request_id': 'req-a1dfb973-7a14-4fe1-a897-def7ef1045bc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.907962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce3df52ef054a17bface27aac7b1815', 'request_id': 'req-a1dfb973-7a14-4fe1-a897-def7ef1045bc'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.920992 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] The token cache is being invalidate because project bce3df52ef054a17bface27aac7b1815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:19.921289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.921974 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a1dfb973-7a14-4fe1-a897-def7ef1045bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:19.923911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1312/2593] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:19 2022] DELETE /identity/v3/projects/bce3df52ef054a17bface27aac7b1815 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:19.929223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:19.929610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:19.929888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:19.947795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:19.948962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.009516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1282/2594] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:20.017476 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.017755 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.018038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.039636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:20.040958 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.049391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1313/2595] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:20.053843 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.060236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:20.064358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e662f9-ddd0-482a-8b29-a9e9a0c064d4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.070779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.071473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.071950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.072384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.073364 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:20.074091 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.075751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.088624 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1283/2596] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:06:20.093007 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.103030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1e540-d2d9-445e-ae56-9b7e6e7963db None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.107710 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.108364 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.108643 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.108915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.109834 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.111521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.150352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1314/2597] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:20.154453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.159146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.161188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.165521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bb131-0093-42a5-8512-034529cdca06 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.225268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.226555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.226837 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.227111 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.227788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.229941 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.238871 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285044-c856-41c3-a50d-7643e44147bf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.244586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.245441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.245720 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.246015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] PATH_INFO: `/v3/projects/4d22e26a9e024cf1a51a71f27c35f8e6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.247328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d22e26a9e024cf1a51a71f27c35f8e6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.249239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.255383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1284/2598] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:20 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:20.256541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.268001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b610c-a0c8-426a-9f30-99556af28d6c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.274820 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.275475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.275755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.276034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.276775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.278654 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.290080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:20.290752 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1285/2599] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:20.294773 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.304862 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65fa5-f231-4f0c-a8b4-b260814dc51d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.306328 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d22e26a9e024cf1a51a71f27c35f8e6', 'request_id': 'req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.312236 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d22e26a9e024cf1a51a71f27c35f8e6', 'request_id': 'req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.321082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d22e26a9e024cf1a51a71f27c35f8e6', 'request_id': 'req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.332145 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] The token cache is being invalidate because project 4d22e26a9e024cf1a51a71f27c35f8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:20.332431 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.333078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.335283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1315/2600] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:20 2022] DELETE /identity/v3/projects/4d22e26a9e024cf1a51a71f27c35f8e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:20.339207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.340562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.366451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.367255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.367544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.367825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.368550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.370155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.380824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1286/2601] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:20.385142 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.386869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.400223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947bd4-e3c6-4bda-b0af-29df0a371895 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.404905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.405821 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.406102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.406408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] PATH_INFO: `/v3/projects/0f17c65c14e84300bbc019c6beedd431/users/e2379c9f1cec4fe1be87678ed9f4ceb5/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.419793 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35502f3-e07c-4a65-9d4c-ed55ecdbc074 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.422014 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f17c65c14e84300bbc019c6beedd431, user_id=e2379c9f1cec4fe1be87678ed9f4ceb5, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.424438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.424704 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c56b-b845-4361-bfe5-061ba856ebf1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.425311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.425594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.425892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] PATH_INFO: `/v3/users/99522d63c4134371bacc443bfd9fd14e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.427103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99522d63c4134371bacc443bfd9fd14e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.429725 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.439558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1287/2602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:20 2022] PUT /identity/v3/projects/0f17c65c14e84300bbc019c6beedd431/users/e2379c9f1cec4fe1be87678ed9f4ceb5/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:20.450270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.450564 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.450846 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.479207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] MFA Rules not processed for user `e2379c9f1cec4fe1be87678ed9f4ceb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:20.480437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.482190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99522d63c4134371bacc443bfd9fd14e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.483027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99522d63c4134371bacc443bfd9fd14e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.483805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99522d63c4134371bacc443bfd9fd14e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.498414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99522d63c4134371bacc443bfd9fd14e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.506299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99522d63c4134371bacc443bfd9fd14e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:20.518347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:20.526382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1316/2603] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:20 2022] DELETE /identity/v3/users/99522d63c4134371bacc443bfd9fd14e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:20.554747 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1288/2604] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:20.565282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.566806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.614615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:20.628494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3597ef-a179-49d4-ab4c-654e2a6b794b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.633320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.633971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.634286 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.634563 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.696491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.697941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327145a-a7d0-497c-9f03-7c77281fd0b6 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:20.707443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1317/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:20.814176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:20.816678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:20.906642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7157-e7be-41cc-9ae7-90580a5fcf35 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:20.972383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:20.973350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:20.973803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:20.974085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] PATH_INFO: `/v3/projects/99f2df6187f043498882ee1c99ffd473` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:20.975541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f2df6187f043498882ee1c99ffd473)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:20.977793 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.038798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f2df6187f043498882ee1c99ffd473', 'request_id': 'req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:21.045459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f2df6187f043498882ee1c99ffd473', 'request_id': 'req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:21.055412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f2df6187f043498882ee1c99ffd473', 'request_id': 'req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:21.066428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] The token cache is being invalidate because project 99f2df6187f043498882ee1c99ffd473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:21.066816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:21.067459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c50e49d0-ff97-4e73-b150-dfd9e8bd223f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:21.069595 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1289/2606] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:20 2022] DELETE /identity/v3/projects/99f2df6187f043498882ee1c99ffd473 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:21.074733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.075033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.075318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.093904 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:21.095206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:21.155799 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1318/2607] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:21.164435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.164814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.165099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.183823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:21.185013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:21.193262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1290/2608] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:21.197886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.207699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238ef26-3e75-4630-87fa-4614c427719b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.212711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.213405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.213733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.214028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.214807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:21.215103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.216713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.229367 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1319/2609] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:06:21.233975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.239283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:21.246310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d1bee-35ad-4579-bef1-db84d74db1af None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.252259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.252965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.253444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.253705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.254521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.256448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.284242 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1291/2610] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:21.286183 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.297244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2fb76-e545-4970-bf58-4d522e308e40 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.356538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.357203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.357487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.357763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.358489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.360409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.380972 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1320/2611] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:21.385167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.395533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed418d-ad42-4c36-bb01-b7a3de0875bd admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.400465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.401118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.401405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.401676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.402430 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.408301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.424931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1292/2612] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:21.430220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.440495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6db9-9b40-48c9-803f-259f6bcd112b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.445606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.446294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.446573 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.446846 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.447566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.449152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7e739-01ee-45fe-b93b-2291aa40cdc2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.459250 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1321/2613] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:21.463816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.473760 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5133-0f0e-4298-b89b-1bb0ec6830a5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.479550 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.480532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.480817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.481094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] PATH_INFO: `/v3/projects/d6e16cffbb1f481fb57e5c6a605b8051/users/a096363a78a64951bd6b3a7ae760c66e/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.495866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e16cffbb1f481fb57e5c6a605b8051, user_id=a096363a78a64951bd6b3a7ae760c66e, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.498614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.511149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1293/2614] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:21 2022] PUT /identity/v3/projects/d6e16cffbb1f481fb57e5c6a605b8051/users/a096363a78a64951bd6b3a7ae760c66e/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:21.523493 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.523828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.524111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.530645 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:21.552556 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] MFA Rules not processed for user `a096363a78a64951bd6b3a7ae760c66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:21.554294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:21.618877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1322/2615] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:21.623338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.684569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b69-1183-4bf9-bc8e-114a32d4669c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.689175 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.689854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.690241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.690523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.691204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.693092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.718350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1294/2616] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:21.722394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.734082 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519eb95-80bc-451a-a5b6-3139e94de9c5 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.794065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.794766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.795056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.795337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.796038 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.797978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.817652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1323/2617] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:21 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:21.822515 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.832684 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701055aa-ef47-46e6-ab73-c7acc805310a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.837954 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.838645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.838931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.839208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.839936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.841531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.852317 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1295/2618] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:21.856760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.866914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21610-bbcc-48d0-89b8-29c48d022ead admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.871640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.872564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.872848 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.873127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] PATH_INFO: `/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0/users/77f9e4418c1347e1b240436614c8519a/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.888240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd4a9ae524b4a21ad250834c6567ae0, user_id=77f9e4418c1347e1b240436614c8519a, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.890939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.903937 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1324/2619] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:21 2022] PUT /identity/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0/users/77f9e4418c1347e1b240436614c8519a/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:21.907841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:21.917916 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf23d-dff0-4413-8631-a88c7f0ba5ba admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:21.974612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:21.975201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:21.975530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:21.975756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:21.976497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:21.978075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdee85-b269-41a0-ae4b-4e8272a27535 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:21.988164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1296/2620] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:21.992569 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:22.002882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6cca8-15f1-46cd-b977-f79e9740e888 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:22.009198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:22.009198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.009438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.009712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] PATH_INFO: `/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0/users/77f9e4418c1347e1b240436614c8519a/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.011685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd4a9ae524b4a21ad250834c6567ae0, user_id=77f9e4418c1347e1b240436614c8519a, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:22.014400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848b503-9925-427a-be0f-05b5e892b56b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:22.025154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1325/2621] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:21 2022] PUT /identity/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0/users/77f9e4418c1347e1b240436614c8519a/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:22.035226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.035519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.035798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.063506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] MFA Rules not processed for user `77f9e4418c1347e1b240436614c8519a`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:22.065059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.078446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:22.140940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.141387 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.141683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.142700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1297/2622] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:22.154106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:22.155466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.161430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] MFA Rules not processed for user `e2379c9f1cec4fe1be87678ed9f4ceb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:22.162673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.206036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:22.215774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ddc56-2c4a-4464-b777-301226ac7596 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:22.219536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:22.220216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.220500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.220776 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.221804 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1326/2623] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:22.230749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:22.232106 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c54bb-83f3-454e-8ebe-773a337a75c1 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:22.243310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1298/2624] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:06:22.313361 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:22.383494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c1c17-708b-4c75-a0ee-c82f6f83379e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:22.399019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:22.399019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.399019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.399019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] PATH_INFO: `/v3/users/a096363a78a64951bd6b3a7ae760c66e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.399441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a096363a78a64951bd6b3a7ae760c66e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:22.401469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:22.454514 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a096363a78a64951bd6b3a7ae760c66e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:22.455201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a096363a78a64951bd6b3a7ae760c66e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:22.455831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a096363a78a64951bd6b3a7ae760c66e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:22.468198 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a096363a78a64951bd6b3a7ae760c66e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:22.475330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a096363a78a64951bd6b3a7ae760c66e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:22.489528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1327/2625] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:22 2022] DELETE /identity/v3/users/a096363a78a64951bd6b3a7ae760c66e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:22.494575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.495129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.495129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.513772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:22.515041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.579816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1299/2626] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:22.589938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:22.591451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.652739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fc72a-20b6-44c8-b323-89949012b06a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:22.656491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:22.657157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:22.657445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:22.657732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:22.668232 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:22.669713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:22.681140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1328/2627] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:22.968384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:22.969858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:22.993505 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea14da-c748-400b-87d0-b79fbbb904b0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:23.010764 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:23.012313 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.013659 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.014169 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] PATH_INFO: `/v3/projects/d6e16cffbb1f481fb57e5c6a605b8051` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.015419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e16cffbb1f481fb57e5c6a605b8051)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:23.017338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:23.067402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:23.078198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e16cffbb1f481fb57e5c6a605b8051', 'request_id': 'req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.084872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e16cffbb1f481fb57e5c6a605b8051', 'request_id': 'req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.092541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e16cffbb1f481fb57e5c6a605b8051', 'request_id': 'req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.105214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] The token cache is being invalidate because project d6e16cffbb1f481fb57e5c6a605b8051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:23.105507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.106338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.108035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1300/2628] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:22 2022] DELETE /identity/v3/projects/d6e16cffbb1f481fb57e5c6a605b8051 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:23.112374 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:23.124307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421b7f0-9195-4ed8-952d-a60c0f7de931 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:23.133353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:23.187248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:23.188133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.188416 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.188693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] PATH_INFO: `/v3/users/77f9e4418c1347e1b240436614c8519a` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.189885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f9e4418c1347e1b240436614c8519a)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:23.191902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:23.244194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f9e4418c1347e1b240436614c8519a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.244873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f9e4418c1347e1b240436614c8519a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.245491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f9e4418c1347e1b240436614c8519a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.258760 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f9e4418c1347e1b240436614c8519a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.266275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3039896-a93a-4ab8-92f3-027cab8d617d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f9e4418c1347e1b240436614c8519a'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.280035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1329/2629] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:23 2022] DELETE /identity/v3/users/77f9e4418c1347e1b240436614c8519a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:23.594367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:23.595928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:23.611677 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d32d7-b9b0-4862-9c4b-61e7f4bc9529 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:23.672555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:23.673441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.673717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.673986 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] PATH_INFO: `/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.675187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd4a9ae524b4a21ad250834c6567ae0)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:23.677070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:23.723208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd4a9ae524b4a21ad250834c6567ae0', 'request_id': 'req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.730174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd4a9ae524b4a21ad250834c6567ae0', 'request_id': 'req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.737177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd4a9ae524b4a21ad250834c6567ae0', 'request_id': 'req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.748220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] The token cache is being invalidate because project 0cd4a9ae524b4a21ad250834c6567ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:23.748513 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.749140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7ae27e7a-3369-4b4b-94eb-2bb9b5db8372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:23.750703 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1301/2630] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:23 2022] DELETE /identity/v3/projects/0cd4a9ae524b4a21ad250834c6567ae0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:23.755667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.756171 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.756835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.777077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:23.779175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:23.842890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1330/2631] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:23.851746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.852041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.852848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.872422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:23.873641 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:23.882346 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1302/2632] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:23.890190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:23.900605 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4d2a7-2a34-47c3-9e16-4ee73a81b578 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:23.905001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:23.906042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.906042 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.906337 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.907079 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:23.907332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:23.909215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:23.923154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1331/2633] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:23.927444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:23.937537 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97150d-74dd-4cb3-bf71-6fb5803ea68c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:23.943062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:23.944497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:23.944782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:23.944895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:23.945754 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:23.948123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:23.982572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1303/2634] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:23 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:23.986874 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:23.997764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0fae3-5b99-4e8b-a32d-078d06587931 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.012187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:24.071531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.072912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.072912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.072912 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.073776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.075819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.100892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1332/2635] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:23 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:24.102302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.113129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b499cd5-ede5-4e67-a6c1-c3bbddba3ca2 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.121972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.122692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.123062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.123405 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.133714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.133714 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.137758 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1304/2636] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:24.141746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.152889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de85f07-19f3-4344-9f3f-80a2a83091cc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.157612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.158463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.158749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.159030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.159757 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.161365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018babd9-331c-40c3-a38e-1820205f887c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.173240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1333/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:24.177383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.188166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc269d-8eaf-4a12-8b16-25969b085890 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.192882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.194351 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.194749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.195119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] PATH_INFO: `/v3/projects/9b71fb9c3cc94f51b6fb7eb19cd0de8e/users/6c480ebf6b8f4ed89366672276f716f2/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.211196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b71fb9c3cc94f51b6fb7eb19cd0de8e, user_id=6c480ebf6b8f4ed89366672276f716f2, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.213838 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.216335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:24.230249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1305/2638] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:24 2022] PUT /identity/v3/projects/9b71fb9c3cc94f51b6fb7eb19cd0de8e/users/6c480ebf6b8f4ed89366672276f716f2/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:24.240406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.240924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.241044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.274285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] MFA Rules not processed for user `6c480ebf6b8f4ed89366672276f716f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:24.275548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:24.344254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1334/2639] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:24.348621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.418688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f3fb8-f7ee-4a24-b6db-e54f44603ff9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.423628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.424375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.424658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.424931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.425670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.427598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.455144 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1306/2640] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:24.459750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.471549 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afbe2d-d3fc-49b2-a3e0-c1fed9c6b90e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.530970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.531204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.531426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.531711 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.532422 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.534448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.554887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1335/2641] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:24.559040 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.570678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eff9b-d34a-4c00-90dd-67e996158da7 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.575602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.576274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.576687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.576824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.577578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.579201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.591000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1307/2642] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:24.595094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.606603 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822c58-7a86-4963-bba5-9afb48814170 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.612177 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.612880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.613165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.613442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.614206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.616938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8c4e7-5add-4688-8224-353e583b22a7 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.627969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1336/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:24.633191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.643692 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97801b83-56a5-4d40-8d7e-0c3bfd421089 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.649223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.650125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.650423 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.650700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] PATH_INFO: `/v3/projects/8cdfa70576c7496b930db4ffc5ab06c6/users/b22c8f99362b4aeab91fd70e6ec8e585/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.684700 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdfa70576c7496b930db4ffc5ab06c6, user_id=b22c8f99362b4aeab91fd70e6ec8e585, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.688035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.707337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1308/2644] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:24 2022] PUT /identity/v3/projects/8cdfa70576c7496b930db4ffc5ab06c6/users/b22c8f99362b4aeab91fd70e6ec8e585/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:24.717502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.718043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.718373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.727541 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:24.760453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] MFA Rules not processed for user `b22c8f99362b4aeab91fd70e6ec8e585`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:24.761980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:24.850847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1337/2645] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:24.855419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.937412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950ff1-9569-4166-a252-ae71a284e7f5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:24.942580 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:24.943186 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:24.944459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:24.944459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:24.945489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:24.947418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:24.976728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1309/2646] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:24.977991 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:24.989870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b542c-7734-44f5-aec3-af4f27c1acde None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.057386 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.058099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.058405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.058687 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.059458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.061426 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.086032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1338/2647] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:24 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:25.090177 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:25.102669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f442e6-7dca-4755-947a-349f850db74b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.107998 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.108673 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.108961 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.109246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.109985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.111629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.124813 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1310/2648] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:25.128780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:25.141056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d48a-7750-4169-9d4e-90d6eae665fa admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.148186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.149080 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.149358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.149717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] PATH_INFO: `/v3/projects/5861ad149ccc4a42a6901d1b3b194309/users/43284225ef3345fb818108d2dc1f1f6d/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.167059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5861ad149ccc4a42a6901d1b3b194309, user_id=43284225ef3345fb818108d2dc1f1f6d, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.169953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.187861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1339/2649] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:25 2022] PUT /identity/v3/projects/5861ad149ccc4a42a6901d1b3b194309/users/43284225ef3345fb818108d2dc1f1f6d/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:25.189119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:25.199867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ade4-6a6d-4e70-a41c-676f9b7dfc61 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.212712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:25.266349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.267274 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.267548 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.267896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.268551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.270355 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ecef-21a0-4153-b942-9e086ad650e2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.287732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1311/2650] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:25.291703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:25.303666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6753d6-8a11-4d1f-ac89-c1e9ff53ba45 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.309159 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.310442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.310744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.311006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] PATH_INFO: `/v3/projects/5861ad149ccc4a42a6901d1b3b194309/users/43284225ef3345fb818108d2dc1f1f6d/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.313076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5861ad149ccc4a42a6901d1b3b194309, user_id=43284225ef3345fb818108d2dc1f1f6d, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.316065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.334577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1340/2651] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:25 2022] PUT /identity/v3/projects/5861ad149ccc4a42a6901d1b3b194309/users/43284225ef3345fb818108d2dc1f1f6d/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:25.340748 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.341041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.341322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.383636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] MFA Rules not processed for user `43284225ef3345fb818108d2dc1f1f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:25.384865 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:25.483708 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1312/2652] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:25.495053 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:25.496900 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:25.556090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:25.572009 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9901-5a5d-4ae8-ab7a-4daf7e3727b8 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:25.584239 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:25.585507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:25.586102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:25.587941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:25.605151 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:25.606798 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:25.620101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1341/2653] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:26.151676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:26.153125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:26.165531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041535b-ba96-4c51-89b4-13751b33c069 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:26.169065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:26.169701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:26.169984 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:26.170291 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:26.230137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:26.231584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:26.240440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1313/2654] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:30.284222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:30.293294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221951d-1812-42fd-9248-1c633aa8367e service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:30.296914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:30.297546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:30.297831 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:30.298125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:30.356167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:30.357680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de2ead-476e-429d-803a-171a6538ab6c service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:30.367973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1342/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:32.443816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:32.486167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:32.508502 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220f9-3780-4461-b929-488360f6a14e service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:32.513002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:32.513866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:32.514174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:32.514449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] PATH_INFO: `/v3/users/6c480ebf6b8f4ed89366672276f716f2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:32.515634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c480ebf6b8f4ed89366672276f716f2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:32.517559 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:32.564391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c480ebf6b8f4ed89366672276f716f2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:32.578380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c480ebf6b8f4ed89366672276f716f2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:32.587519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c480ebf6b8f4ed89366672276f716f2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:32.594698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c480ebf6b8f4ed89366672276f716f2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:32.595349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c480ebf6b8f4ed89366672276f716f2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:32.602152 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1314/2656] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:32 2022] DELETE /identity/v3/users/6c480ebf6b8f4ed89366672276f716f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:32.607244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:32.607750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:32.607853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:32.625206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:32.626352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:32.689114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1343/2657] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:32.699400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:32.700949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:32.764459 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca74f4-6e1e-47b4-b859-006dbf95dde8 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:32.767166 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:32.767824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:32.768108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:32.768383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:32.779032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:32.780471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:32.790824 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1315/2658] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:33.079916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:33.081910 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:33.106562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971ba42-e6ad-45d9-b837-b64d76e46e40 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:33.112305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:33.113346 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:33.113637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:33.113940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] PATH_INFO: `/v3/projects/9b71fb9c3cc94f51b6fb7eb19cd0de8e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:33.115370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b71fb9c3cc94f51b6fb7eb19cd0de8e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:33.117959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:33.177813 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b71fb9c3cc94f51b6fb7eb19cd0de8e', 'request_id': 'req-0706681e-8c0e-411c-a84d-8c9b6108d785'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.192067 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b71fb9c3cc94f51b6fb7eb19cd0de8e', 'request_id': 'req-0706681e-8c0e-411c-a84d-8c9b6108d785'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.203838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b71fb9c3cc94f51b6fb7eb19cd0de8e', 'request_id': 'req-0706681e-8c0e-411c-a84d-8c9b6108d785'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.216679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] The token cache is being invalidate because project 9b71fb9c3cc94f51b6fb7eb19cd0de8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:33.217070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.217805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.219822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1344/2659] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:33 2022] DELETE /identity/v3/projects/9b71fb9c3cc94f51b6fb7eb19cd0de8e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:33.223596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:33.235965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2bc39-dd4d-4c3a-aa6e-a722e213bc3c service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:33.323780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:33.324903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:33.325359 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:33.325966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] PATH_INFO: `/v3/users/b22c8f99362b4aeab91fd70e6ec8e585` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:33.327489 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22c8f99362b4aeab91fd70e6ec8e585)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:33.330009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:33.332336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:33.396032 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22c8f99362b4aeab91fd70e6ec8e585'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.416623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22c8f99362b4aeab91fd70e6ec8e585'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.425740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22c8f99362b4aeab91fd70e6ec8e585'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.435854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22c8f99362b4aeab91fd70e6ec8e585'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.436539 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-a71b150f-ba20-4c9b-956c-73d4a94d52ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22c8f99362b4aeab91fd70e6ec8e585'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.442665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1316/2660] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:33 2022] DELETE /identity/v3/users/b22c8f99362b4aeab91fd70e6ec8e585 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:33.714886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:33.716357 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:33.746146 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706681e-8c0e-411c-a84d-8c9b6108d785 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:33.757986 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:33.828785 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:33.829650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:33.829940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:33.830244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] PATH_INFO: `/v3/projects/8cdfa70576c7496b930db4ffc5ab06c6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:33.831535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdfa70576c7496b930db4ffc5ab06c6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:33.833505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:33.886470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdfa70576c7496b930db4ffc5ab06c6', 'request_id': 'req-691b0d35-283a-4dcc-9852-bc0e45034f7e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.892081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:33.892543 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:33.892669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdfa70576c7496b930db4ffc5ab06c6', 'request_id': 'req-691b0d35-283a-4dcc-9852-bc0e45034f7e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.892833 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:33.901600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdfa70576c7496b930db4ffc5ab06c6', 'request_id': 'req-691b0d35-283a-4dcc-9852-bc0e45034f7e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.911900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:33.913032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] The token cache is being invalidate because project 8cdfa70576c7496b930db4ffc5ab06c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:33.913288 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:33.913415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.913943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:33.915562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1345/2661] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:33 2022] DELETE /identity/v3/projects/8cdfa70576c7496b930db4ffc5ab06c6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:33.919427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:33.920744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:33.971973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1317/2662] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:33.985637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b0d35-283a-4dcc-9852-bc0e45034f7e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:33.990681 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:33.991550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:33.991970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:33.992262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] PATH_INFO: `/v3/users/43284225ef3345fb818108d2dc1f1f6d` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:33.993749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43284225ef3345fb818108d2dc1f1f6d)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:33.994412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:33.995800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:33.995915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.045253 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:34.048586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43284225ef3345fb818108d2dc1f1f6d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.049938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43284225ef3345fb818108d2dc1f1f6d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.050960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43284225ef3345fb818108d2dc1f1f6d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.070565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17900-76db-4f13-9030-d55adfa896a7 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.071005 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43284225ef3345fb818108d2dc1f1f6d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.076120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.076774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.077059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.077337 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.078327 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43284225ef3345fb818108d2dc1f1f6d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.079225 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.090985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.092002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1346/2663] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:33 2022] DELETE /identity/v3/users/43284225ef3345fb818108d2dc1f1f6d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:34.092596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147b482-cb61-419d-aa40-b851471c755a service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.101478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1318/2664] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:06:34.385949 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.387959 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.465756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0c90-1a0b-494b-9d66-c5d9e98e3517 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.470429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.471429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.471709 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.472056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] PATH_INFO: `/v3/projects/5861ad149ccc4a42a6901d1b3b194309` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.473248 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5861ad149ccc4a42a6901d1b3b194309)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.475225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.526449 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5861ad149ccc4a42a6901d1b3b194309', 'request_id': 'req-1cd4eab4-eebc-408d-8496-bd7faf95744f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.534628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5861ad149ccc4a42a6901d1b3b194309', 'request_id': 'req-1cd4eab4-eebc-408d-8496-bd7faf95744f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.544417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5861ad149ccc4a42a6901d1b3b194309', 'request_id': 'req-1cd4eab4-eebc-408d-8496-bd7faf95744f'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.556655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] The token cache is being invalidate because project 5861ad149ccc4a42a6901d1b3b194309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:34.556938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.557554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1cd4eab4-eebc-408d-8496-bd7faf95744f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:34.559117 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1347/2665] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:34 2022] DELETE /identity/v3/projects/5861ad149ccc4a42a6901d1b3b194309 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:34.565044 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eafaf-274d-41d7-8abd-d596c684daf9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.565319 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eafaf-274d-41d7-8abd-d596c684daf9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.565596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eafaf-274d-41d7-8abd-d596c684daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.587003 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-da3eafaf-274d-41d7-8abd-d596c684daf9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:34.588269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-da3eafaf-274d-41d7-8abd-d596c684daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.598001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:34.656372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1319/2666] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:34.665905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.666227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.666505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.671870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.672164 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.672594 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.688263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:34.689515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.693523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:34.695054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.699519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1348/2667] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:34.704116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.715016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1eb8c-0c37-4317-811c-69f0c8fda6dc None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.720164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.720843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.721126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.721400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.722175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:34.722679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.724338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.743246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1349/2668] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:34.744503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.755231 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179a5fa-a901-424d-8947-2758bb769824 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.760796 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.761506 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.761819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.762100 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.763014 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.763145 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1320/2669] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:34.765103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.776892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.780102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:34.808779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1350/2670] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:34 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:34.810315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.823173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:34.869731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e93d8-3aa1-4f01-b97b-c2154ee069c0 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.885004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfa35d-fa28-4120-90b4-766e622a333e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.889666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.890504 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.890791 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.891073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.891794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.893713 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.917765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1351/2671] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:34 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:34.919206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.926372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:34.929873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620767-3c26-4583-a7de-b579578d51ab admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.934616 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.934766 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.935282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.935416 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.935584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.935715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.935880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.935985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.936601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.938252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.949542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1352/2672] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:34.953837 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.963649 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41849c1-7a56-4c49-bf1a-58c708d18d10 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:34.968376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:34.969148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:34.969439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:34.969717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:34.970466 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.972076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.986696 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1353/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:34.987675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:34.993500 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:34.995120 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f843c-ef8a-4340-b3ed-119825b12e35 service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:34.997855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bfba3-3511-4c55-87b4-a3f79f4e1f80 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.002702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.003385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1321/2674] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:06:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:06:35.003567 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.003847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.004119 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] PATH_INFO: `/v3/projects/96fa2311a18340bdaf593ed11e8125b3/users/f8296b28f5ce484ba0c3155cae0fe160/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.019560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fa2311a18340bdaf593ed11e8125b3, user_id=f8296b28f5ce484ba0c3155cae0fe160, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.022521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.036741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1354/2675] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:34 2022] PUT /identity/v3/projects/96fa2311a18340bdaf593ed11e8125b3/users/f8296b28f5ce484ba0c3155cae0fe160/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:35.048826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe086-45c4-4bd4-bcfc-a2a71cbb5ece None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.049195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe086-45c4-4bd4-bcfc-a2a71cbb5ece None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.049506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe086-45c4-4bd4-bcfc-a2a71cbb5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.078680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c51fe086-45c4-4bd4-bcfc-a2a71cbb5ece None None] MFA Rules not processed for user `f8296b28f5ce484ba0c3155cae0fe160`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:35.079882 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c51fe086-45c4-4bd4-bcfc-a2a71cbb5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:35.149645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1322/2676] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:35.154868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.203934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.204231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.204520 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.221564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94953-9e96-423e-8875-5cae220cf87c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.222791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:35.223992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:35.226945 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.227606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.228150 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.228441 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.229126 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.231108 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.257463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1355/2677] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:35.261227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.289325 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1323/2678] 10.222.0.36 () {58 vars in 1009 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:35.301385 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.304400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.327598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb7c4-a0e4-4748-81a3-5d0971a40323 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.332672 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.333342 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.333627 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.333903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.335168 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.337113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.342658 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=100 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.360420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1356/2679] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:06:35.361412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.371166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b23c24-fd97-4bfb-a3da-d2b92497aa5c admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.374452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b28b5-edf0-466a-9be2-2be730e4a4c8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.384353 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.385021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.385303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.385578 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.386420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.388037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.399642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1357/2680] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:35.403495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.413886 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0633fe-6a61-498e-b34f-f8d6d5368441 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.418818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.419474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.419758 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.420034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.420789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.422448 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.434970 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1358/2681] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:35.438996 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.444898 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.445488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.445772 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.446053 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.449703 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6fd2-8c90-401b-93e1-1218a51b2a5a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.454309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.455165 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.455467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.455723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] PATH_INFO: `/v3/projects/1d328fad57a54053bd74d65b56d29302/users/a9992fb29b6246009b0a4a6d17ea4bc8/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.470589 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d328fad57a54053bd74d65b56d29302, user_id=a9992fb29b6246009b0a4a6d17ea4bc8, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.473256 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69e4a-ea23-4206-982a-204e27906b14 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.486513 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1359/2682] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:35 2022] PUT /identity/v3/projects/1d328fad57a54053bd74d65b56d29302/users/a9992fb29b6246009b0a4a6d17ea4bc8/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:35.496794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.497084 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.497362 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.503780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.505373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.514572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1324/2683] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:06:35.524838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] MFA Rules not processed for user `a9992fb29b6246009b0a4a6d17ea4bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:35.526140 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:35.595209 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1360/2684] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:35.599730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.611854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e0262-b57c-47cc-baff-582917530b15 service swift] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.671923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.672587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.672872 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.673148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.673849 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.675761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.703490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1325/2685] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:35.707658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.719470 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ed68-df77-4408-8eb2-d570493c810f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.778792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.779474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.779765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.780045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.780750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.782708 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa12ef-5a63-4c5b-852a-3a0cddc83c41 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.798280 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.806947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1361/2686] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:35.808544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.819809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4070a80-fb03-4857-9534-0663bb47c367 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.824525 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.825280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.825632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.825973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.826792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.828446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.829904 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:35.842741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.842877 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1326/2687] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:35.843226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.843608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.846817 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.857806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94310a-178f-481e-a9ff-31acabba9b52 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.862419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.863227 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] MFA Rules not processed for user `7229ef6d88a04c57b7e83485be988aee`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:35.863377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.863587 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.863869 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] PATH_INFO: `/v3/projects/97dab85574e641aaaa3f62ee89acba33/users/92afa1e552154821885619ace23bad8f/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.864836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:35.878933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dab85574e641aaaa3f62ee89acba33, user_id=92afa1e552154821885619ace23bad8f, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.882417 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.895724 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1327/2688] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:35 2022] PUT /identity/v3/projects/97dab85574e641aaaa3f62ee89acba33/users/92afa1e552154821885619ace23bad8f/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:35.900394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.926319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1362/2689] 10.222.0.36 () {58 vars in 967 bytes} [Tue May 24 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:35.938535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:35.966649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503ad1-6ba4-40c6-9abe-cc73f1a35677 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:35.971617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:35.972290 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:35.972572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:35.972850 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:35.973572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:35.975836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:35.986586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1328/2690] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:35.990493 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:36.000572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2670-ded6-4dd1-bcce-9b886c88f71d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:36.005419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:36.006501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:36.006786 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:36.007063 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] PATH_INFO: `/v3/projects/97dab85574e641aaaa3f62ee89acba33/users/92afa1e552154821885619ace23bad8f/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:36.008030 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614242cd-7bb7-4b72-a065-ec30a8a9321e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:36.009024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dab85574e641aaaa3f62ee89acba33, user_id=92afa1e552154821885619ace23bad8f, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:36.011735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272a61-5ff3-4f06-bdec-0ec70231be50 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:36.023129 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1329/2691] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:35 2022] PUT /identity/v3/projects/97dab85574e641aaaa3f62ee89acba33/users/92afa1e552154821885619ace23bad8f/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:36.033204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ba85-d461-4144-8627-b98212577396 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:36.033491 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ba85-d461-4144-8627-b98212577396 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:36.033761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ba85-d461-4144-8627-b98212577396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:36.061259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b827ba85-d461-4144-8627-b98212577396 None None] MFA Rules not processed for user `92afa1e552154821885619ace23bad8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:36.062521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b827ba85-d461-4144-8627-b98212577396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:36.069429 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2871bcf4578040648c19fb6eb9464261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:36.070244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:36.070636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:36.071016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:36.119830 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:36.129291 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:36.130930 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:36.134701 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1330/2692] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:36.140332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1363/2693] 10.222.0.36 () {60 vars in 1384 bytes} [Tue May 24 13:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 13:06:36.145826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ba85-d461-4144-8627-b98212577396 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:36.147289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b827ba85-d461-4144-8627-b98212577396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:36.194179 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:36.213532 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ba85-d461-4144-8627-b98212577396 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:36.217511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:36.218189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:36.218421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:36.218730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:36.229059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:36.230534 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:36.240422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1331/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:06:36.289859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:36.349658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc117ee-7b61-45da-bec0-44f616d51bee service swift] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:36.354596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:36.355217 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:36.355847 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:36.356131 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:36.423730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:36.425184 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba0860-f624-40ed-a3a1-f611a0719c0a service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:36.435303 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1364/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:38.219333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:38.220761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:38.289519 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976f6e-4a32-47e1-9c3c-1ead48cfc4ea service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:38.294000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:38.294891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:38.295168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:38.295438 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] PATH_INFO: `/v3/users/e2379c9f1cec4fe1be87678ed9f4ceb5` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:38.296607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2379c9f1cec4fe1be87678ed9f4ceb5)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:38.298561 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:38.347049 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2379c9f1cec4fe1be87678ed9f4ceb5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.360486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2379c9f1cec4fe1be87678ed9f4ceb5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.368449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2379c9f1cec4fe1be87678ed9f4ceb5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.375881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2379c9f1cec4fe1be87678ed9f4ceb5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.376533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2379c9f1cec4fe1be87678ed9f4ceb5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.382800 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1332/2696] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:38 2022] DELETE /identity/v3/users/e2379c9f1cec4fe1be87678ed9f4ceb5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:38.387403 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:38.387861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:38.387997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:38.405295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:38.406777 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:38.468790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1365/2697] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:38.479233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:38.480660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:38.537085 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4f371-0071-4397-afbc-c042d403c570 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:38.541311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:38.541891 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:38.542208 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:38.542488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:38.551540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:38.553034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:38.563563 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1333/2698] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:06:38.741174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:38.742682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:38.755542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dc174-fe38-4782-a9f2-027415fb953f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:38.761271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:38.761730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:38.762016 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:38.762325 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] PATH_INFO: `/v3/projects/0f17c65c14e84300bbc019c6beedd431` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:38.763598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f17c65c14e84300bbc019c6beedd431)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:38.765693 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:38.808118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:38.815296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f17c65c14e84300bbc019c6beedd431', 'request_id': 'req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.821247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f17c65c14e84300bbc019c6beedd431', 'request_id': 'req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.828616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f17c65c14e84300bbc019c6beedd431', 'request_id': 'req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.840420 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] The token cache is being invalidate because project 0f17c65c14e84300bbc019c6beedd431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:38.840705 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.841317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-233cf4d7-86a8-4b88-bc00-0a1e98f974fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:38.842969 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1366/2699] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:38 2022] DELETE /identity/v3/projects/0f17c65c14e84300bbc019c6beedd431 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:39.287162 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:39.288555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:39.297647 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:39.301943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e9c9d-b427-4465-b57b-bed53aa11ae1 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:39.361226 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:39.362236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:39.362531 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:39.362810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] PATH_INFO: `/v3/users/f8296b28f5ce484ba0c3155cae0fe160` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:39.363997 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8296b28f5ce484ba0c3155cae0fe160)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:39.365897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:39.412329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8296b28f5ce484ba0c3155cae0fe160'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.424469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8296b28f5ce484ba0c3155cae0fe160'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.432452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8296b28f5ce484ba0c3155cae0fe160'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.439452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8296b28f5ce484ba0c3155cae0fe160'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.440075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8296b28f5ce484ba0c3155cae0fe160'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.446929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1334/2700] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:39 2022] DELETE /identity/v3/users/f8296b28f5ce484ba0c3155cae0fe160 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:39.451520 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:39.451995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:39.451995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:39.469868 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:39.471102 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:39.529483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1367/2701] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:39.539151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:39.540533 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:39.596991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41621bc2-2dcf-49cd-b40c-bfdfb53e9c9b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:39.600687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:39.601444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:39.601730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:39.602008 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:39.611374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:39.612785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:39.623398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1335/2702] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:39.892111 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:39.893546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:39.905636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd86d7-b9bc-4f1d-891a-ed4142da0857 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:39.910317 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:39.911189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:39.911474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:39.911750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] PATH_INFO: `/v3/projects/96fa2311a18340bdaf593ed11e8125b3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:39.912942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fa2311a18340bdaf593ed11e8125b3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:39.915479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:39.964445 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fa2311a18340bdaf593ed11e8125b3', 'request_id': 'req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.969825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fa2311a18340bdaf593ed11e8125b3', 'request_id': 'req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.978438 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fa2311a18340bdaf593ed11e8125b3', 'request_id': 'req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.989182 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] The token cache is being invalidate because project 96fa2311a18340bdaf593ed11e8125b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:39.989473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.990093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:39.992233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1368/2703] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:39 2022] DELETE /identity/v3/projects/96fa2311a18340bdaf593ed11e8125b3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:39.996383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:40.006728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e47268-07a8-42e0-9c7e-a3330a914763 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:40.030259 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:40.066472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:40.067349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:40.067635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:40.067911 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] PATH_INFO: `/v3/users/a9992fb29b6246009b0a4a6d17ea4bc8` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:40.069087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9992fb29b6246009b0a4a6d17ea4bc8)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:40.071176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:40.116380 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9992fb29b6246009b0a4a6d17ea4bc8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.128718 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9992fb29b6246009b0a4a6d17ea4bc8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.136123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9992fb29b6246009b0a4a6d17ea4bc8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.142950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9992fb29b6246009b0a4a6d17ea4bc8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.143603 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9992fb29b6246009b0a4a6d17ea4bc8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.149915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1336/2704] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:39 2022] DELETE /identity/v3/users/a9992fb29b6246009b0a4a6d17ea4bc8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:40.417851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:40.419363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:40.436538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d223ee-c9f7-4785-a8bd-1b4b9a6edf27 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:40.485323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:40.501397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:40.502600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:40.503046 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:40.503446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] PATH_INFO: `/v3/projects/1d328fad57a54053bd74d65b56d29302` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:40.504771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d328fad57a54053bd74d65b56d29302)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:40.506729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:40.553614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d328fad57a54053bd74d65b56d29302', 'request_id': 'req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.560020 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d328fad57a54053bd74d65b56d29302', 'request_id': 'req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.566861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d328fad57a54053bd74d65b56d29302', 'request_id': 'req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.578243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] The token cache is being invalidate because project 1d328fad57a54053bd74d65b56d29302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:40.578534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.579157 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.580678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1369/2705] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:40 2022] DELETE /identity/v3/projects/1d328fad57a54053bd74d65b56d29302 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:40.584607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:40.586087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:40.598802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6d2e-5360-4d22-95e9-a403c318b87e admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:40.666975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:40.667863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:40.668151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:40.668433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] PATH_INFO: `/v3/users/92afa1e552154821885619ace23bad8f` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:40.669623 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92afa1e552154821885619ace23bad8f)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:40.671569 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:40.719858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92afa1e552154821885619ace23bad8f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.721108 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:40.737019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92afa1e552154821885619ace23bad8f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.744792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92afa1e552154821885619ace23bad8f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.752664 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92afa1e552154821885619ace23bad8f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.753261 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-c21a5d0f-d755-4264-8ac5-ec46a19ef1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92afa1e552154821885619ace23bad8f'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:40.759795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1337/2706] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:40 2022] DELETE /identity/v3/users/92afa1e552154821885619ace23bad8f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:41.051360 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.053221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:41.073216 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9ccd-2037-4d5d-9769-68a5a5a4a30b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.130135 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.130998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.131283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.131559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] PATH_INFO: `/v3/projects/97dab85574e641aaaa3f62ee89acba33` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.133629 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dab85574e641aaaa3f62ee89acba33)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.135599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.181139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dab85574e641aaaa3f62ee89acba33', 'request_id': 'req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:41.186636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dab85574e641aaaa3f62ee89acba33', 'request_id': 'req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:41.193929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dab85574e641aaaa3f62ee89acba33', 'request_id': 'req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:41.205689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] The token cache is being invalidate because project 97dab85574e641aaaa3f62ee89acba33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:41.205981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:41.206652 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-4ef69bf4-f5ad-45f3-9fc8-97b1297f32cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:41.208190 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1370/2707] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:41 2022] DELETE /identity/v3/projects/97dab85574e641aaaa3f62ee89acba33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:41.214090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.214411 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.214689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.232957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:41.234181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:41.295217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1338/2708] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:41.358310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.358604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.358919 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.378091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:41.379377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:41.388003 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1371/2709] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:41.392214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.402674 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4cc15-8a02-4429-8769-0dc87c27da14 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.407239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.407899 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.408194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.408466 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.409197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:41.409503 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.411131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.423663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1339/2710] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:41.428212 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.434682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:41.438370 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e708c8-d736-45b0-b105-cb8e0167cc18 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.444546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.445600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.446101 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.446465 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.447332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.449354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.473650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1372/2711] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:41.478826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.488742 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8119e97-66c3-47a1-9611-89bc1c80054d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.544335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.544993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.545333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.545557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.546264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.548156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.567687 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1340/2712] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:41.571973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.582269 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c3da-6349-4f7d-8da9-dee10ba8cd40 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.586960 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.587612 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.587895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.588170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.588890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.590546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.601593 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1373/2713] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:41.605909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.615949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4746-057f-41da-a865-cb4160816c41 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.621642 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.622339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.622628 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.622907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.623632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.625213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8e35a-8773-47cb-81d7-4a447a1dcc66 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.635607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1341/2714] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:06:41.639544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.650069 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea40f-41c1-4a21-a23c-6d3ed4aff615 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.654809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.655683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.655967 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.656245 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] PATH_INFO: `/v3/projects/6228d8cf8a774bb69a6f4cff5d2d9fd3/users/9435adcbf97641f3a2f67f4d4b23fe85/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.671026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6228d8cf8a774bb69a6f4cff5d2d9fd3, user_id=9435adcbf97641f3a2f67f4d4b23fe85, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.673664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.686743 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1374/2715] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:41 2022] PUT /identity/v3/projects/6228d8cf8a774bb69a6f4cff5d2d9fd3/users/9435adcbf97641f3a2f67f4d4b23fe85/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:41.697799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.698096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.698398 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.726554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] MFA Rules not processed for user `9435adcbf97641f3a2f67f4d4b23fe85`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:41.728021 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:41.746149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:41.795069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1342/2716] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:41.799702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.862980 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0a880-fcb1-4601-be60-888eb3a5ea26 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.867915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.868575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.868862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.869141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.869853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.871839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.897012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1375/2717] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:41.901582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:41.912168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e3f42-8feb-4069-9905-ac4cade258a8 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:41.970540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:41.971196 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:41.971476 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:41.971750 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:41.972432 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:41.974356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:41.995598 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1343/2718] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:41 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:41.999491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.010446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3ef0-93a2-422a-b0a8-bae944f2592b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.015143 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.015803 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.016088 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.016366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.017093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.018748 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.030666 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1376/2719] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:42.034584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.045001 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c4ebe-881a-4820-8b5d-c91a88a47c1b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.049832 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.050720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.050993 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.051271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] PATH_INFO: `/v3/projects/9fd865827e7844e494ba2376f4273869/users/e7cb5c642cb745b794ef4a97fe9e11ca/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.065908 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd865827e7844e494ba2376f4273869, user_id=e7cb5c642cb745b794ef4a97fe9e11ca, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.069089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.083810 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1344/2720] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:42 2022] PUT /identity/v3/projects/9fd865827e7844e494ba2376f4273869/users/e7cb5c642cb745b794ef4a97fe9e11ca/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:42.088408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.098453 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00426-d6a6-4201-ac5a-87355807fa20 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.158133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.158807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.159090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.159366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.160091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.161699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c9943-2d19-4e41-896d-721fd85fa29f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.172604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1377/2721] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:42.176711 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.187816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866f432-2b13-4ee1-9f09-288899071f8f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.192482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.193372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.193666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.193945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] PATH_INFO: `/v3/projects/9fd865827e7844e494ba2376f4273869/users/e7cb5c642cb745b794ef4a97fe9e11ca/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.196526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd865827e7844e494ba2376f4273869, user_id=e7cb5c642cb745b794ef4a97fe9e11ca, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.199199 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.209976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1345/2722] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:42 2022] PUT /identity/v3/projects/9fd865827e7844e494ba2376f4273869/users/e7cb5c642cb745b794ef4a97fe9e11ca/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:42.221022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.221443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.221759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.250829 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] MFA Rules not processed for user `e7cb5c642cb745b794ef4a97fe9e11ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:42.251568 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:42.258744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:42.327754 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1378/2723] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:42.339625 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.341507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:42.402055 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f40b97-c8e7-44f4-9466-a0ef033d6f57 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.405888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.406584 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.406868 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.407141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.417433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.418931 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.429052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1346/2724] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:42.503207 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.513533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22f3f-be43-4647-af7d-391c0fe1d2f1 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.517379 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.518095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.518477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.518823 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.578058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.579510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda1dcc-2656-495c-8ce0-c8390bd31f43 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.589884 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1379/2725] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:42.864763 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:42.883482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:42.930734 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b8265-190d-484a-99fd-c6e444ff41c7 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:42.935336 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:42.936239 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:42.936526 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:42.936801 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] PATH_INFO: `/v3/users/9435adcbf97641f3a2f67f4d4b23fe85` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:42.937994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9435adcbf97641f3a2f67f4d4b23fe85)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:42.939947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:42.990139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9435adcbf97641f3a2f67f4d4b23fe85'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.003361 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9435adcbf97641f3a2f67f4d4b23fe85'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.011987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9435adcbf97641f3a2f67f4d4b23fe85'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.019806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9435adcbf97641f3a2f67f4d4b23fe85'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.020478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9435adcbf97641f3a2f67f4d4b23fe85'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.027223 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1347/2726] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:42 2022] DELETE /identity/v3/users/9435adcbf97641f3a2f67f4d4b23fe85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:43.031745 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:43.032040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:43.032324 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:43.050142 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:43.051399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:43.153396 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1380/2727] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:43.165094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:43.166576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:43.254769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18043585-b8fa-46af-a231-98bccb1c8972 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:43.264079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:43.265339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:43.265980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:43.266779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:43.282266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:43.284148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:43.296988 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1348/2728] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:43.655316 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:43.657501 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:43.670998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49297-1748-4c28-bd6f-72d7920edc1d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:43.675994 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:43.676946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:43.677319 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:43.677662 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] PATH_INFO: `/v3/projects/6228d8cf8a774bb69a6f4cff5d2d9fd3` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:43.679736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6228d8cf8a774bb69a6f4cff5d2d9fd3)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:43.681844 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:43.722395 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:43.733075 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6228d8cf8a774bb69a6f4cff5d2d9fd3', 'request_id': 'req-5675c7c7-3926-4bde-8819-7be699f88a2e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.738728 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6228d8cf8a774bb69a6f4cff5d2d9fd3', 'request_id': 'req-5675c7c7-3926-4bde-8819-7be699f88a2e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.747485 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6228d8cf8a774bb69a6f4cff5d2d9fd3', 'request_id': 'req-5675c7c7-3926-4bde-8819-7be699f88a2e'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.759601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] The token cache is being invalidate because project 6228d8cf8a774bb69a6f4cff5d2d9fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:43.759889 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.760539 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.762314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1381/2729] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:43 2022] DELETE /identity/v3/projects/6228d8cf8a774bb69a6f4cff5d2d9fd3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:43.766071 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:43.775951 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d0b6-74b2-452e-86a9-eb88fff61e2c service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:43.813933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:43.840644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:43.841804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:43.842088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:43.842391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] PATH_INFO: `/v3/users/e7cb5c642cb745b794ef4a97fe9e11ca` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:43.843669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cb5c642cb745b794ef4a97fe9e11ca)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:43.845574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:43.892414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cb5c642cb745b794ef4a97fe9e11ca'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.905221 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cb5c642cb745b794ef4a97fe9e11ca'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.914073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cb5c642cb745b794ef4a97fe9e11ca'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.926233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cb5c642cb745b794ef4a97fe9e11ca'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.927218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-afe25335-3c7f-4c1f-b967-2088fd72420a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cb5c642cb745b794ef4a97fe9e11ca'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:43.935146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1349/2730] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:43 2022] DELETE /identity/v3/users/e7cb5c642cb745b794ef4a97fe9e11ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:44.230686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.232181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:44.249753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675c7c7-3926-4bde-8819-7be699f88a2e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.307070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.307924 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.308261 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.308535 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] PATH_INFO: `/v3/projects/9fd865827e7844e494ba2376f4273869` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.309742 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd865827e7844e494ba2376f4273869)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.311716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.358105 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd865827e7844e494ba2376f4273869', 'request_id': 'req-65f95937-5605-446c-ad1c-58e1fe0e0ce1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:44.363543 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd865827e7844e494ba2376f4273869', 'request_id': 'req-65f95937-5605-446c-ad1c-58e1fe0e0ce1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:44.370978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd865827e7844e494ba2376f4273869', 'request_id': 'req-65f95937-5605-446c-ad1c-58e1fe0e0ce1'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:44.383446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] The token cache is being invalidate because project 9fd865827e7844e494ba2376f4273869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:44.383734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:44.384390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-65f95937-5605-446c-ad1c-58e1fe0e0ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:44.385927 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1382/2731] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:44 2022] DELETE /identity/v3/projects/9fd865827e7844e494ba2376f4273869 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:44.391034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.391330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.391737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.410661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:44.411923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:44.491486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1350/2732] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:44.500538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.500836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.501113 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.519859 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:44.521073 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:44.529665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1383/2733] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:44.533856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.543579 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764059-d2bb-4f4c-9332-17b81eb2c52d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.548146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.548806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.549089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.549365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.550098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:44.550451 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.552042 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.564447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1351/2734] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:06:44.568756 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.580310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74eb72-c551-4499-bd08-b3a216a5cbb7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.586650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.587424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.587763 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.588138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.589019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.591307 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.628066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1384/2735] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:44 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:44.632989 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.643482 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9085d-97c9-4839-bb59-807089b9c6ac admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.687333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:44.706181 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.706863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.707149 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.707435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.708147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.710150 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.732856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1352/2736] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:44 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:44.736726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.748405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae7fe-0157-47d1-9869-e3e329a7db84 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.753197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.753940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.754320 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.754600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.755355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.757892 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.772066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1385/2737] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:44.774322 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.785388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a30db-6d0d-4c1e-98fd-ff36bcada1f5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.790803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.791557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.791903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.792245 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.793050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.794851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2114d2-4077-480d-8158-9972302925f1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.807816 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1353/2738] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:44.812021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.823306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec523ba8-f345-4665-a140-c66a1c684331 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:44.828169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:44.829141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.829424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.829700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] PATH_INFO: `/v3/projects/9c56cfb602c34e08af21cef0d871988e/users/d70c02216a5c4216b21e350581f24957/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.842983 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:44.846494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c56cfb602c34e08af21cef0d871988e, user_id=d70c02216a5c4216b21e350581f24957, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:44.849464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:44.863931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1386/2739] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:44 2022] PUT /identity/v3/projects/9c56cfb602c34e08af21cef0d871988e/users/d70c02216a5c4216b21e350581f24957/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:44.875061 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:44.875461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:44.875809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:44.903738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] MFA Rules not processed for user `d70c02216a5c4216b21e350581f24957`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:44.904948 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:44.973867 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1354/2740] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:44.985454 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:44.987301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:45.048906 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59684f-7677-4fa1-a793-e815abe9e2a6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:45.052610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:45.053260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:45.054242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:45.054638 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:45.065071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:45.066566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abaed5-7650-4bc3-a447-de78cef963de service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:45.076931 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1387/2741] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:45.105599 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:45.178154 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe0f2-42cf-48e3-8090-299a56a21f5e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:45.183878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:45.185300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:45.185608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:45.185888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] PATH_INFO: `/v3/users/d70c02216a5c4216b21e350581f24957` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:45.187163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70c02216a5c4216b21e350581f24957)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:45.189070 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:45.237478 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70c02216a5c4216b21e350581f24957'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.243803 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:45.252450 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70c02216a5c4216b21e350581f24957'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.260289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70c02216a5c4216b21e350581f24957'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.268287 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70c02216a5c4216b21e350581f24957'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.269170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70c02216a5c4216b21e350581f24957'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.275924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1355/2742] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:45 2022] DELETE /identity/v3/users/d70c02216a5c4216b21e350581f24957 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:45.281559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:45.281860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:45.282176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:45.300285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:45.301599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:45.363735 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1388/2743] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:45.374644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:45.376084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:45.434187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e973d-376a-4833-8482-1065eda6d6a5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:45.437895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:45.438578 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:45.438866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:45.439146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:45.448213 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:45.449640 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:45.459307 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1356/2744] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:45.734558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:45.736077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:45.751158 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614994b-0d75-4942-92c9-a59f6ff8964c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:45.756028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:45.757526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:45.757809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:45.758086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] PATH_INFO: `/v3/projects/9c56cfb602c34e08af21cef0d871988e` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:45.759414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c56cfb602c34e08af21cef0d871988e)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:45.761436 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:45.807482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c56cfb602c34e08af21cef0d871988e', 'request_id': 'req-7f0ee142-343f-49d7-9d6d-d1d613e565da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.813489 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c56cfb602c34e08af21cef0d871988e', 'request_id': 'req-7f0ee142-343f-49d7-9d6d-d1d613e565da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.821634 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c56cfb602c34e08af21cef0d871988e', 'request_id': 'req-7f0ee142-343f-49d7-9d6d-d1d613e565da'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.833004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] The token cache is being invalidate because project 9c56cfb602c34e08af21cef0d871988e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:45.833296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.833926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:45.836125 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1389/2745] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:45 2022] DELETE /identity/v3/projects/9c56cfb602c34e08af21cef0d871988e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:47.493035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:47.494497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:47.505560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805408-67e7-41d2-9981-fe3625b4ff38 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:47.553632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:47.554304 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:47.554589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:47.554863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:47.556604 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:47.618269 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:47.619688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:47.629312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1357/2746] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:50.691905 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:50.693446 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:50.723243 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:50.756079 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:50.758452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:50.784804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a140e-6f5a-4eb8-ac66-a57d9c643806 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:50.791424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:50.792841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:50.793041 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:50.793333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] PATH_INFO: `/v3/users/96d14f2ef79a4fac94127b2274ea88e3` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:50.794851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d14f2ef79a4fac94127b2274ea88e3)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:50.796769 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:50.814826 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee142-343f-49d7-9d6d-d1d613e565da admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:50.820769 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:50.821439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:50.821723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:50.821995 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:50.824430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:50.824985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:50.840240 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:50.842128 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:50.860277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1390/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:50.863024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d14f2ef79a4fac94127b2274ea88e3'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:50.877761 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d14f2ef79a4fac94127b2274ea88e3'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:50.900678 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d14f2ef79a4fac94127b2274ea88e3'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:50.908148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d14f2ef79a4fac94127b2274ea88e3'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:50.908806 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-db8df42c-e1e2-4ab8-9294-6715557327da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d14f2ef79a4fac94127b2274ea88e3'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:50.915413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1358/2748] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:06:50 2022] DELETE /identity/v3/users/96d14f2ef79a4fac94127b2274ea88e3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:51.083909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.097671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafd9a-d8e8-4ef2-9275-a9dcb3ff7abb service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.156640 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.157495 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.157783 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.158063 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] PATH_INFO: `/v3/projects/e8b40fb446274de791e05cd45262cde1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.159271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b40fb446274de791e05cd45262cde1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.161179 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.205965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b40fb446274de791e05cd45262cde1', 'request_id': 'req-c15ab581-4d84-430b-860d-c0e75394338d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:51.212263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b40fb446274de791e05cd45262cde1', 'request_id': 'req-c15ab581-4d84-430b-860d-c0e75394338d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:51.219447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b40fb446274de791e05cd45262cde1', 'request_id': 'req-c15ab581-4d84-430b-860d-c0e75394338d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:51.231024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] The token cache is being invalidate because project e8b40fb446274de791e05cd45262cde1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:06:51.231315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:51.231993 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-c15ab581-4d84-430b-860d-c0e75394338d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:06:51.233594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1391/2749] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:06:51 2022] DELETE /identity/v3/projects/e8b40fb446274de791e05cd45262cde1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:06:51.238586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.238888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.239194 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.262830 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:51.264038 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:51.326976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1359/2750] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:06:51.335354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.335654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.335939 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.354206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:51.355415 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:51.363246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1392/2751] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:51.367956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.377699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4945-8513-4936-abb2-26ab1466c85d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.383052 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.383728 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.383999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.384298 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.385054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:06:51.385357 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.386987 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.398746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1360/2752] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 13:06:51.403095 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.412630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7dde-531b-4ea1-9bbb-f6d978a51dfd None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.417413 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.418064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.418417 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.418695 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.419383 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.421283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.447729 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1393/2753] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:06:51 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:51.451949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.462266 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216ebe-75e7-484a-9adc-45a02673a6c2 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.519804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.520497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.520785 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.521064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.521774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.523749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.543412 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1361/2754] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:06:51 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:06:51.547533 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.558323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd1a-dd49-48e3-b023-ec03d60ba5da admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.562908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.563559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.563842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.564118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.564841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.566472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.568498 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:51.579450 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1394/2755] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:51.582854 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.593250 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c093b0-314d-4dec-a1c8-14346027d6ef admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.597888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.598566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.598853 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.599130 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.599852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.601444 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd23839-3e37-45fa-89e7-ee0137478eba admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.611895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1362/2756] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:06:51.616669 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.626690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e746-5258-4404-ba16-d9035b6a859e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.631281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.632688 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.632966 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.633238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] PATH_INFO: `/v3/projects/4bbbbb562c0a4cbf9a570ad30ee7783c/users/262453e74e1c49d889af09febd168ad8/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.647604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bbbbb562c0a4cbf9a570ad30ee7783c, user_id=262453e74e1c49d889af09febd168ad8, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.650281 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.662948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1395/2757] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:06:51 2022] PUT /identity/v3/projects/4bbbbb562c0a4cbf9a570ad30ee7783c/users/262453e74e1c49d889af09febd168ad8/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:06:51.667933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de7dce-f461-4e69-a978-84f217d0e4c9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.668231 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de7dce-f461-4e69-a978-84f217d0e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.668517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de7dce-f461-4e69-a978-84f217d0e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.674782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:06:51.690059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-65de7dce-f461-4e69-a978-84f217d0e4c9 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:51.691270 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-65de7dce-f461-4e69-a978-84f217d0e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:51.751219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1363/2758] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:51.761238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:51.763023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:51.819461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163541-9ee2-48c8-a441-70f3368dffbf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:51.823156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:51.823794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:51.824078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:51.824355 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:51.833285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:51.834835 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:51.844238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1396/2759] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:55.765606 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07834-c202-48a9-9541-ef29a510bcd4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:55.766178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07834-c202-48a9-9541-ef29a510bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:55.766371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e07834-c202-48a9-9541-ef29a510bcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:55.795191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-17e07834-c202-48a9-9541-ef29a510bcd4 None None] MFA Rules not processed for user `262453e74e1c49d889af09febd168ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:55.796408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-17e07834-c202-48a9-9541-ef29a510bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:55.872551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1364/2760] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:55.888251 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:55.889690 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:55.967909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a19df-b6a5-4037-82bb-3a73bd26ff7f service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:55.973407 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:55.974065 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:55.974377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:55.974650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:55.983592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:55.985199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:55.996047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1397/2761] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:06:57.286315 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf5e5-3510-40cb-8e95-1fba761b5a4b None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:57.287019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf5e5-3510-40cb-8e95-1fba761b5a4b None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:57.287019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf5e5-3510-40cb-8e95-1fba761b5a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:57.306529 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-cfeaf5e5-3510-40cb-8e95-1fba761b5a4b None None] MFA Rules not processed for user `262453e74e1c49d889af09febd168ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:06:57.307755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cfeaf5e5-3510-40cb-8e95-1fba761b5a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:57.315062 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1365/2762] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:06:57.644717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:06:57.646338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:57.659221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a309f17-f7b9-4866-86ce-62e2837f37c6 service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:06:57.663499 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:06:57.664164 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:06:57.664447 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:06:57.664724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:06:57.666592 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:06:57.677134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:06:57.678715 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:06:57.687805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1398/2763] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:07:07.299297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=61 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:07.683682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:07:42.210549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b81b-1051-4188-a358-22952cb82268 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:07:42.211174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b81b-1051-4188-a358-22952cb82268 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:07:42.211174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b81b-1051-4188-a358-22952cb82268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:07:42.229201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-97c2b81b-1051-4188-a358-22952cb82268 None None] MFA Rules not processed for user `262453e74e1c49d889af09febd168ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:07:42.230455 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-97c2b81b-1051-4188-a358-22952cb82268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:07:42.237807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1366/2764] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:07:52.223204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:24.522852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:08:24.524909 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:08:24.622920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6272438-e007-4a12-a7da-5b15843e8f39 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:08:24.629973 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:08:24.630806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:08:24.631228 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:08:24.631794 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:08:24.633802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:08:24.649679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:08:24.651424 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55528-d572-4078-889e-6432ccd158d9 service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:08:24.664469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1399/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:08:33.425880 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:08:33.426428 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:08:33.426535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:08:33.444693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] MFA Rules not processed for user `262453e74e1c49d889af09febd168ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:08:33.445955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:08:33.452792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1367/2766] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:08:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:08:34.657765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=32 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:08:43.438878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:09:30.326885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:09:30.327412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:09:30.327516 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:09:30.345206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] MFA Rules not processed for user `262453e74e1c49d889af09febd168ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:09:30.346433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:09:30.354304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1400/2767] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:09:40.340483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:13.727330 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:13.728738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:13.785228 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3bfd5-5aa7-4e82-b52d-437bc05c3ff4 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:13.788896 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:13.789542 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:13.789831 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:13.790126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:13.792549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:13.805732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:13.807183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:13.818048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1368/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:15.337739 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:15.339221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:15.351397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a399f98-91db-45f0-80d5-87288294e94c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:15.355092 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:15.355727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:15.356012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:15.356289 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:15.358012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:15.371566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:15.372998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:15.384326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1401/2769] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:23.813234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=26 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:25.379349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=6 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:27.676925 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:27.690693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08278305-6b64-45d4-be0d-7fffb21e9d76 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:27.698025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:27.698952 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:27.699234 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:27.699727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] PATH_INFO: `/v3/users/262453e74e1c49d889af09febd168ad8` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:27.701887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262453e74e1c49d889af09febd168ad8)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:27.703834 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:27.757252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262453e74e1c49d889af09febd168ad8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:27.772940 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262453e74e1c49d889af09febd168ad8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:27.782201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262453e74e1c49d889af09febd168ad8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:27.789900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262453e74e1c49d889af09febd168ad8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:27.790663 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-51651d3d-78ef-4991-a01b-3901956e7756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262453e74e1c49d889af09febd168ad8'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:27.797098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1369/2770] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:10:27 2022] DELETE /identity/v3/users/262453e74e1c49d889af09febd168ad8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:27.976862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:27.988792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2c0bb-0aed-4505-9eb3-0bf348d47c09 service cinder] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.046427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.047278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.047560 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.047833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] PATH_INFO: `/v3/projects/4bbbbb562c0a4cbf9a570ad30ee7783c` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.049004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bbbbb562c0a4cbf9a570ad30ee7783c)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.050946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.096034 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbbbb562c0a4cbf9a570ad30ee7783c', 'request_id': 'req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:28.101655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbbbb562c0a4cbf9a570ad30ee7783c', 'request_id': 'req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:28.109604 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbbbb562c0a4cbf9a570ad30ee7783c', 'request_id': 'req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:28.120778 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] The token cache is being invalidate because project 4bbbbb562c0a4cbf9a570ad30ee7783c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:10:28.121066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:28.121733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fc6b6dab-f7bc-40d4-a550-2f7ac7fdd481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:28.123275 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1402/2771] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:10:27 2022] DELETE /identity/v3/projects/4bbbbb562c0a4cbf9a570ad30ee7783c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:28.128143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.128437 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.128719 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.146187 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:28.147394 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:28.206680 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1370/2772] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:28.214192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.214608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.214962 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.234427 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:28.235636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:28.243507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1403/2773] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:28.247784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.257429 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d58402-532b-4af8-92c1-ee20d61c5356 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.262013 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.263224 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.263507 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.263783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.264506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:10:28.264815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.266421 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.277943 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1371/2774] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:10:28.283035 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.292503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e738d2f-c831-41e3-9192-8376af62f72b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.297646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.298375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.298663 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.298940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.299630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.301561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.330174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1404/2775] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:10:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:28.331723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.342140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd915543-f228-40f5-858e-ed602396aea2 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.397966 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.398666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.398950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.399227 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.399909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.401805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.411751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:28.430252 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1372/2776] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:10:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:28.434136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.444293 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4514f4-94fe-4900-8135-7a5b31e827b9 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.448899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.449547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.450469 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.450749 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.451654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.453290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.463566 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1405/2777] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:28.468847 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.479464 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815a60-5fb0-47ec-b2cb-7ad5d3830327 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.484659 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.485312 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.485593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.485866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.486620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.488195 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b69925-ea39-40ba-b002-1b8d0d9cd4bf admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.498819 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1373/2778] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:10:28.502862 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.514015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e493ef1-09fa-4fe7-93c1-72413266049b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.518667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.519538 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.519817 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.520091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] PATH_INFO: `/v3/projects/7b6c14f26cb9402482e1fa508f9be287/users/d0bd9bd2571c48f299824a2c01928f58/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.535744 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6c14f26cb9402482e1fa508f9be287, user_id=d0bd9bd2571c48f299824a2c01928f58, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.538399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.551896 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1406/2779] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:28 2022] PUT /identity/v3/projects/7b6c14f26cb9402482e1fa508f9be287/users/d0bd9bd2571c48f299824a2c01928f58/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:28.562311 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.562635 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.562945 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.591744 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] MFA Rules not processed for user `d0bd9bd2571c48f299824a2c01928f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:28.592766 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:28.660915 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1374/2780] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:28.672176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:28.673964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:28.707683 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:28.755536 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6487-436d-4302-8ba4-f956a4b901d4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:28.760878 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:28.761515 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:28.761797 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:28.762070 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:28.770731 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:28.772304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80c47e-1d56-4f93-b752-25de9e0d6288 service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:28.781412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1407/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:33.946697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.007841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cc83c-98a9-4d43-adea-af631a223aca None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.013333 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.014247 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.014527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.014799 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] PATH_INFO: `/v3/users/d0bd9bd2571c48f299824a2c01928f58` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.015967 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bd9bd2571c48f299824a2c01928f58)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.017851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.066544 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bd9bd2571c48f299824a2c01928f58'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.079136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bd9bd2571c48f299824a2c01928f58'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.082690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:34.087609 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bd9bd2571c48f299824a2c01928f58'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.096722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bd9bd2571c48f299824a2c01928f58'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.097350 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bd9bd2571c48f299824a2c01928f58'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.103457 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1375/2782] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:10:33 2022] DELETE /identity/v3/users/d0bd9bd2571c48f299824a2c01928f58 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:34.108148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.108655 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.108765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.126031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:34.127266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:34.186558 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1408/2783] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:10:34.196067 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.197514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:34.257119 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649dce1-c1fe-44b5-96d6-1e105348bbc1 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.260804 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.261453 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.261741 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.262023 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.271756 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.273182 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394bf96-ed51-4adf-8ed5-94b9ffb9f694 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.282751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1376/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:34.559732 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.561166 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:34.573233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e1e09-f3f5-434b-9218-b1d89ee1109b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.578895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.579765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.580047 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.580323 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] PATH_INFO: `/v3/projects/7b6c14f26cb9402482e1fa508f9be287` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.581522 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6c14f26cb9402482e1fa508f9be287)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.583606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.633671 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6c14f26cb9402482e1fa508f9be287', 'request_id': 'req-1881f267-2519-490d-b534-ad2971f8afe3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.639738 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6c14f26cb9402482e1fa508f9be287', 'request_id': 'req-1881f267-2519-490d-b534-ad2971f8afe3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.646664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6c14f26cb9402482e1fa508f9be287', 'request_id': 'req-1881f267-2519-490d-b534-ad2971f8afe3'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.658097 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] The token cache is being invalidate because project 7b6c14f26cb9402482e1fa508f9be287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:10:34.658414 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.659044 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-1881f267-2519-490d-b534-ad2971f8afe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:34.660575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1409/2785] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:10:34 2022] DELETE /identity/v3/projects/7b6c14f26cb9402482e1fa508f9be287 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:34.665386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.665676 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.665955 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.684372 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:34.685576 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:34.745893 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1377/2786] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:34.753836 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.754136 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.754433 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.772430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:34.773637 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:34.782087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1410/2787] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:34.786098 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.796840 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64d8e9-e01e-4c90-a6a1-dd7176e518fb None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.801445 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.802151 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.802442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.802739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.803471 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:10:34.803779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.805403 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.817418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1378/2788] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:10:34.821860 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.831780 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d6b30-1de0-441f-aaa7-cd57e87f61d4 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.836443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.837094 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.837601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.837881 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.838615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.841195 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.867500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1411/2789] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:10:34 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:34.872131 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.882373 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6cd4f-cbcb-4326-9e58-9897e1096f0c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.939617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.940285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.940573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.940852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.941551 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.943492 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.963393 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1379/2790] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:10:34 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:10:34.968266 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:34.978953 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b1b36-4c15-4119-81c1-d79ef055aef2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:34.984455 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:34.985118 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:34.985409 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:34.985692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:34.986451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:34.988059 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:34.989349 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:35.000554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1412/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:35.004845 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.015465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988b088-8324-4d6c-a1de-5c5885168a77 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.020037 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.020688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.020973 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.021249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.021972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.023590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2f1a-3427-43e3-bb7e-9f6aed7da32f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.024851 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:35.036402 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1380/2792] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:35.040464 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.050507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938a29-8a78-4e85-a3f8-86a1006fc9f4 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.055156 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.056026 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.056309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.056587 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] PATH_INFO: `/v3/projects/c3c0cd9bdaea408997e2ef01162a1221/users/8f489249a89e4eee8161532ac66bc3ec/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.071116 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c0cd9bdaea408997e2ef01162a1221, user_id=8f489249a89e4eee8161532ac66bc3ec, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.073762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.087339 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1413/2793] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:35 2022] PUT /identity/v3/projects/c3c0cd9bdaea408997e2ef01162a1221/users/8f489249a89e4eee8161532ac66bc3ec/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:35.098985 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.100156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.100156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.126301 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] MFA Rules not processed for user `8f489249a89e4eee8161532ac66bc3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:35.127424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:35.191480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1381/2794] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:35.195897 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.258352 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bc94a-a081-41c3-8812-3b0b6ef1087e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.264001 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.264677 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.265072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.265358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.266052 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.268018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.295582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1414/2795] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:10:35 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 13:10:35.299694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.310541 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14078631-58cd-4e98-9937-a4001df0e35e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.366523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.367183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.367469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.367745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.368419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.370341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.390720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1382/2796] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:10:35 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:35.394616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.406318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b38690-07a2-40cc-ba86-5216adb1f2f3 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.411123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.411789 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.412076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.412356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.413086 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.414936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.426290 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1415/2797] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:35.430419 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.441404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b321e7-fab7-432f-ae66-fde0986a703c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.445991 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.446903 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.447180 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.447446 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] PATH_INFO: `/v3/projects/d3dc922d52ad4f12b432ba731d57a66a/users/027c6f9820194eaf828ce6aac9c037b2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.463082 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dc922d52ad4f12b432ba731d57a66a, user_id=027c6f9820194eaf828ce6aac9c037b2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.466338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.479335 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1383/2798] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:35 2022] PUT /identity/v3/projects/d3dc922d52ad4f12b432ba731d57a66a/users/027c6f9820194eaf828ce6aac9c037b2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:35.483273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.493635 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600cc4-2244-495d-8e5c-b221293c5b63 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.549220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.549879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.550189 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.550471 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.551187 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.552801 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ce6dc-b42e-436a-a628-e06aefaa740a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.563366 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1416/2799] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:35.567588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.578384 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf2f8-b413-467a-99f1-f031f7568640 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.583172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.584065 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.584356 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.584632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] PATH_INFO: `/v3/projects/d3dc922d52ad4f12b432ba731d57a66a/users/027c6f9820194eaf828ce6aac9c037b2/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.586662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dc922d52ad4f12b432ba731d57a66a, user_id=027c6f9820194eaf828ce6aac9c037b2, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.589316 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.599607 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1384/2800] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:35 2022] PUT /identity/v3/projects/d3dc922d52ad4f12b432ba731d57a66a/users/027c6f9820194eaf828ce6aac9c037b2/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:35.611321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.611618 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.611902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.638824 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] MFA Rules not processed for user `027c6f9820194eaf828ce6aac9c037b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:35.640028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:35.669478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:35.708521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1417/2801] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:35.719887 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.721608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:35.764051 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:35.780102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c2f-f6f2-4bae-b359-a21d2cc74c6b admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.783735 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.784408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.784690 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.784963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.794809 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.796273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.805705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1385/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:35 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:35.877385 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:35.887012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1897cb4-7c38-450c-a66b-d183e09c4330 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:35.890664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:35.891299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:35.891582 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:35.891858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:35.948098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:35.949461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc613baf-c859-43c1-ace4-931bc1cfeea1 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:35.958341 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1418/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:35 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:45.801497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=9 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:45.954294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=43 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:50.938345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:51.002147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5bf2-1bc2-4d56-966d-e165df05c156 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:51.007289 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:51.008374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:51.008689 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:51.009034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] PATH_INFO: `/v3/users/8f489249a89e4eee8161532ac66bc3ec` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:51.010558 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f489249a89e4eee8161532ac66bc3ec)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:51.013160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:51.060048 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f489249a89e4eee8161532ac66bc3ec'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.072404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f489249a89e4eee8161532ac66bc3ec'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.080153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f489249a89e4eee8161532ac66bc3ec'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.087087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f489249a89e4eee8161532ac66bc3ec'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.087755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f489249a89e4eee8161532ac66bc3ec'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.093709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1386/2804] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:10:50 2022] DELETE /identity/v3/users/8f489249a89e4eee8161532ac66bc3ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:51.098356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:51.098820 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:51.098933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:51.116772 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:51.118006 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:51.176921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1419/2805] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:51.187386 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:51.188775 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:51.246452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea348e7-c017-45b8-a9f5-a57e6b3a1bd9 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:51.250161 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:51.250808 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:51.251092 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:51.251365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:51.260271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:51.261688 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:51.271510 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1387/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:51.530936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:51.532434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:51.545077 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadb45f-569f-4333-b547-09c88678ae6e None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:51.550356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:51.551221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:51.551505 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:51.551779 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] PATH_INFO: `/v3/projects/c3c0cd9bdaea408997e2ef01162a1221` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:51.552978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c0cd9bdaea408997e2ef01162a1221)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:51.554963 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:51.601882 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c0cd9bdaea408997e2ef01162a1221', 'request_id': 'req-9b84204f-13fb-4b0d-8a9d-0ef282a27795'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.608110 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c0cd9bdaea408997e2ef01162a1221', 'request_id': 'req-9b84204f-13fb-4b0d-8a9d-0ef282a27795'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.616103 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c0cd9bdaea408997e2ef01162a1221', 'request_id': 'req-9b84204f-13fb-4b0d-8a9d-0ef282a27795'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.627155 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] The token cache is being invalidate because project c3c0cd9bdaea408997e2ef01162a1221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:10:51.627459 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.628078 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.629608 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1420/2807] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:10:51 2022] DELETE /identity/v3/projects/c3c0cd9bdaea408997e2ef01162a1221 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:51.633527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:51.643388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a104-2010-4dab-9f36-a92bf2ad90d9 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:51.661582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:51.701637 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:51.702573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:51.702863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:51.703141 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] PATH_INFO: `/v3/users/027c6f9820194eaf828ce6aac9c037b2` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:51.704329 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027c6f9820194eaf828ce6aac9c037b2)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:51.706340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:51.753395 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027c6f9820194eaf828ce6aac9c037b2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.765732 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027c6f9820194eaf828ce6aac9c037b2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.772283 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027c6f9820194eaf828ce6aac9c037b2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.779216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027c6f9820194eaf828ce6aac9c037b2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.780382 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-7a5f26a7-f10d-4e94-83dc-c84bfec21319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027c6f9820194eaf828ce6aac9c037b2'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:51.786264 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1388/2808] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:10:51 2022] DELETE /identity/v3/users/027c6f9820194eaf828ce6aac9c037b2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:52.053599 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.055087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:52.069134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84204f-13fb-4b0d-8a9d-0ef282a27795 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.126242 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.127104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.127390 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.127673 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] PATH_INFO: `/v3/projects/d3dc922d52ad4f12b432ba731d57a66a` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.128855 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3dc922d52ad4f12b432ba731d57a66a)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.130850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.160090 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:52.178336 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3dc922d52ad4f12b432ba731d57a66a', 'request_id': 'req-fcba9995-3ea8-43a3-bac2-efd0da9cf419'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:52.183822 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3dc922d52ad4f12b432ba731d57a66a', 'request_id': 'req-fcba9995-3ea8-43a3-bac2-efd0da9cf419'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:52.192091 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3dc922d52ad4f12b432ba731d57a66a', 'request_id': 'req-fcba9995-3ea8-43a3-bac2-efd0da9cf419'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:52.203574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] The token cache is being invalidate because project d3dc922d52ad4f12b432ba731d57a66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:10:52.203866 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:52.204507 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-fcba9995-3ea8-43a3-bac2-efd0da9cf419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:10:52.206056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1421/2809] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:10:52 2022] DELETE /identity/v3/projects/d3dc922d52ad4f12b432ba731d57a66a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:52.211216 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.211699 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.211798 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.229797 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:52.230972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:52.291668 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1389/2810] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:52.300432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.300726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.301012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.319340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:52.320544 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:52.328977 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1422/2811] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:52.333118 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.343255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd7e57-1f23-42b1-a60c-80f801f9dc4c None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.347844 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.348495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.348779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.349054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.349780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:10:52.350087 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.351959 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.364572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1390/2812] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:10:52.368870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.378432 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31599060-6868-4d81-88b2-7baa1b4c406b None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.383098 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.383750 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.384037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.384315 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.385004 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.387048 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.414121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1423/2813] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:52.418472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.429328 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6dfef-8f67-4e12-8cb4-9746aab02bf6 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.455458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:52.488188 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.488784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.489069 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.489343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.490035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.491958 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.511159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1391/2814] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:52.515463 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.525800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a22d9-d444-4b00-8c00-3fea957b5053 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.531397 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.532041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.532322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.532601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.533314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.534941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.546458 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1424/2815] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:52.550339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.560184 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547562c9-f8cb-4026-9c81-4f276724ed4c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.565146 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.565802 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.566089 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.566400 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.567125 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.568698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035cd0a-48cd-43e0-b9a8-a9caa9dda829 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.579059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1392/2816] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:52.583115 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.593740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a91b9-4335-4ee1-a72f-e72cbd7e828f admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.598376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.599247 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.599530 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.599807 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] PATH_INFO: `/v3/projects/d2d649c1a9e345e8b60852b3d1c8d66b/users/1742e28e23374e13ae5823cfbb2a66b0/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.616169 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d649c1a9e345e8b60852b3d1c8d66b, user_id=1742e28e23374e13ae5823cfbb2a66b0, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.618842 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.632399 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1425/2817] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:52 2022] PUT /identity/v3/projects/d2d649c1a9e345e8b60852b3d1c8d66b/users/1742e28e23374e13ae5823cfbb2a66b0/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:52.643593 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.643950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.644232 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.671284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] MFA Rules not processed for user `1742e28e23374e13ae5823cfbb2a66b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:52.672490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:52.737320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1393/2818] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:52.741869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.803885 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff314-0f7c-4078-907c-f188737fe74d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.808502 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.809152 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.809430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.809702 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.810405 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.812723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.837482 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1426/2819] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:52.841461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.853281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb318308-a09a-4726-8818-9fb63bb3b3de None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.911591 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.912262 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.912546 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.912823 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.913514 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.915480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.934858 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1394/2820] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:10:52 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:10:52.938873 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.949149 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350707-b2b3-44fa-ac8b-0baaf425c55e admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.954313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.954968 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.955254 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.955531 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:52.956257 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:52.957852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:52.969199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1427/2821] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:52.973165 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:52.983209 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020008-44d9-421b-99af-217bab6916f8 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:52.987909 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:52.988789 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:52.989074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:52.989347 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] PATH_INFO: `/v3/projects/6efc1a637a284ec189ef7d75a0ffade9/users/4ced6125854e41b580eea2165581f858/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:53.004367 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efc1a637a284ec189ef7d75a0ffade9, user_id=4ced6125854e41b580eea2165581f858, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:53.006972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:53.020081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1395/2822] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:52 2022] PUT /identity/v3/projects/6efc1a637a284ec189ef7d75a0ffade9/users/4ced6125854e41b580eea2165581f858/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:53.024017 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:53.034197 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa82c0c-c5a4-411e-9b49-085cba43069b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:53.053615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:53.091940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:53.092654 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:53.092940 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:53.093220 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:53.093941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:53.095581 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb5050-9494-4fff-82f6-943a8268fbf2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:53.105689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1428/2823] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:10:53.110387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:53.115929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:10:53.122693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcaf6f-e5a5-491e-8777-ac2466ac99b3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:53.128207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:53.129090 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:53.129374 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:53.129650 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] PATH_INFO: `/v3/projects/6efc1a637a284ec189ef7d75a0ffade9/users/4ced6125854e41b580eea2165581f858/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:53.131659 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efc1a637a284ec189ef7d75a0ffade9, user_id=4ced6125854e41b580eea2165581f858, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:53.134321 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:53.144538 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1396/2824] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:10:53 2022] PUT /identity/v3/projects/6efc1a637a284ec189ef7d75a0ffade9/users/4ced6125854e41b580eea2165581f858/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:10:53.156314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:53.156806 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:53.156925 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:53.184178 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] MFA Rules not processed for user `4ced6125854e41b580eea2165581f858`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:10:53.185377 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:53.252723 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1429/2825] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:10:53.263495 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:53.265191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:10:53.323527 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141112a-7171-45ef-8ccc-270924691f88 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:53.327467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:53.328110 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:53.328397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:53.328683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:53.384698 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:53.386160 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:53.395669 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1397/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:10:55.932838 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:10:55.943076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e304e-ed22-4328-9329-dfdd460c9c9d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:10:55.946610 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:10:55.947246 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:10:55.947528 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:10:55.947802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:10:55.956730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:10:55.958180 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ec20-9dd0-43a9-87ea-9050d042aef4 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:10:55.967475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1430/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:03.392406 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:05.963313 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=58 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:08.319933 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:08.383077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d186dce-2cd8-4377-aded-813f2669f0e0 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:08.387693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:08.388602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:08.388889 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:08.389170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] PATH_INFO: `/v3/users/1742e28e23374e13ae5823cfbb2a66b0` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:08.390391 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1742e28e23374e13ae5823cfbb2a66b0)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:08.392302 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:08.442220 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1742e28e23374e13ae5823cfbb2a66b0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:08.456214 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1742e28e23374e13ae5823cfbb2a66b0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:08.464143 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1742e28e23374e13ae5823cfbb2a66b0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:08.474212 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1742e28e23374e13ae5823cfbb2a66b0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:08.474964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1742e28e23374e13ae5823cfbb2a66b0'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:08.481597 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1398/2828] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:08 2022] DELETE /identity/v3/users/1742e28e23374e13ae5823cfbb2a66b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:08.486310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:08.486879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:08.486879 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:08.506944 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:08.508173 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:08.574278 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1431/2829] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:11:08.584796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:08.586284 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:08.645639 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99e2f6-e3b0-4676-b184-dccd9e647a16 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:08.649320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:08.649962 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:08.650277 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:08.650555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:08.660241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:08.662035 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:08.671586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1399/2830] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:11:08.933022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:08.934564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:08.948941 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcff8e-fef2-4fa9-aece-2cc77e6ef12c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:08.953550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:08.955051 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:08.955343 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:08.956617 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] PATH_INFO: `/v3/projects/d2d649c1a9e345e8b60852b3d1c8d66b` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:08.958022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d649c1a9e345e8b60852b3d1c8d66b)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:08.959957 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.010288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d649c1a9e345e8b60852b3d1c8d66b', 'request_id': 'req-ef3b7c37-a3eb-4143-9219-b60f608223d0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.015746 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d649c1a9e345e8b60852b3d1c8d66b', 'request_id': 'req-ef3b7c37-a3eb-4143-9219-b60f608223d0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.023717 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d649c1a9e345e8b60852b3d1c8d66b', 'request_id': 'req-ef3b7c37-a3eb-4143-9219-b60f608223d0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.035365 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] The token cache is being invalidate because project d2d649c1a9e345e8b60852b3d1c8d66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:09.035661 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.036322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.037887 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1432/2831] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:08 2022] DELETE /identity/v3/projects/d2d649c1a9e345e8b60852b3d1c8d66b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:09.041792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.052073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcbcc-8d1f-4fbf-bf06-96f946d6cd85 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.070557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:09.111388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.112709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.113088 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.113371 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] PATH_INFO: `/v3/users/4ced6125854e41b580eea2165581f858` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.114582 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ced6125854e41b580eea2165581f858)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.116497 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.161753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ced6125854e41b580eea2165581f858'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.173516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ced6125854e41b580eea2165581f858'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.180782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ced6125854e41b580eea2165581f858'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.187788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ced6125854e41b580eea2165581f858'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.188484 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0e726c11-925c-4dce-bfdb-ed95de3196c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ced6125854e41b580eea2165581f858'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.194768 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1400/2832] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:09 2022] DELETE /identity/v3/users/4ced6125854e41b580eea2165581f858 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:09.461093 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.462600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:09.476926 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7c37-a3eb-4143-9219-b60f608223d0 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.535167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.536024 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.536304 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.536576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] PATH_INFO: `/v3/projects/6efc1a637a284ec189ef7d75a0ffade9` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.537741 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efc1a637a284ec189ef7d75a0ffade9)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.539701 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.570956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:09.588811 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efc1a637a284ec189ef7d75a0ffade9', 'request_id': 'req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.594265 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efc1a637a284ec189ef7d75a0ffade9', 'request_id': 'req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.602665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efc1a637a284ec189ef7d75a0ffade9', 'request_id': 'req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.614206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] The token cache is being invalidate because project 6efc1a637a284ec189ef7d75a0ffade9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:09.614500 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.615134 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-a3bef8f5-ad20-4a93-8a18-7c9d57e3e5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:09.616659 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1433/2833] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:09 2022] DELETE /identity/v3/projects/6efc1a637a284ec189ef7d75a0ffade9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:09.621530 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.622018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.622136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.639947 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:09.641113 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:09.699815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1401/2834] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:11:09.707559 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.707851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.708133 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.727263 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:09.728475 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:09.736394 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1434/2835] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:09.741155 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.750784 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40ef73-24bf-49fc-894e-d5cb0982f90e None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.755475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.756123 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.756407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.756682 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.757408 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:11:09.757720 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.759344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.771615 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1402/2836] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:11:09.775700 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.785805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1ca08-8376-45d6-97b0-c4ab4da31186 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.790574 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.791225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.791510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.791790 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.792479 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.794442 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.822545 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1435/2837] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:09 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:09.824036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.834780 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8057-bbb8-48d9-9a0b-8688735531b8 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.860950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:09.894645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.895236 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.895516 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.895783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.896456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.898365 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.917999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1403/2838] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:09 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:09.922226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.932825 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f981f-3292-4527-a14b-cbd24eb287d6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.937412 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.938064 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.938406 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.938682 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.939400 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.941170 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.952978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1436/2839] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:09.957271 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.967073 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4f29-551c-40d2-ab17-fa831252ef93 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:09.972258 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:09.972900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:09.973185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:09.973458 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:09.974207 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:09.975779 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e7737-cda2-4964-8e87-489349abe1aa admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:09.986018 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1404/2840] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:09.990021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:09.999776 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d59a2-25de-4a0d-9cc8-69e1d86d9e65 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.004684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.005548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.005828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.006104 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] PATH_INFO: `/v3/projects/2f9e0845d76c47108c94fa109c92aa8f/users/10e38079d77141aabf72207de602fc18/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.021473 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9e0845d76c47108c94fa109c92aa8f, user_id=10e38079d77141aabf72207de602fc18, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.024127 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.037555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1437/2841] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:09 2022] PUT /identity/v3/projects/2f9e0845d76c47108c94fa109c92aa8f/users/10e38079d77141aabf72207de602fc18/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:10.048632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.048924 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.049201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.075192 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] MFA Rules not processed for user `10e38079d77141aabf72207de602fc18`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:10.076431 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:10.140549 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1405/2842] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:11:10.145727 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.207356 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51162e50-6c86-4ffd-8821-42695ec442e5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.212023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.212679 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.212964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.213241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.213923 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.215856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.241295 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1438/2843] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:10 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:10.245414 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.256480 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8021ea7-b3f1-4c03-960d-d8d6136510cd None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.312410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.313076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.313358 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.313632 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.314339 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.317198 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.337078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1406/2844] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:10 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:10.341041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.351810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763fcaf-58b7-4798-8c9a-7ea3dc04549b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.356616 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.357273 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.357554 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.357827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.358619 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.360208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.371759 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1439/2845] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:10.375788 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.386767 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892fee-5709-4894-9e8e-5f8c50a7906c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.391727 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.392610 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.392890 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.393738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] PATH_INFO: `/v3/projects/3346bec236bf4836bc3e0e60b693441f/users/8a92841d42c14dbfad34ff25114d67a6/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.408918 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3346bec236bf4836bc3e0e60b693441f, user_id=8a92841d42c14dbfad34ff25114d67a6, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.412084 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.425730 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1407/2846] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:10 2022] PUT /identity/v3/projects/3346bec236bf4836bc3e0e60b693441f/users/8a92841d42c14dbfad34ff25114d67a6/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:10.429684 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.439632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688c9c5-594d-4d84-b495-824f2a28658b admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.460631 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:10.497580 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.498271 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.498557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.498841 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.499557 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.501230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa359b-2fd0-4311-b439-bd3b59e6f382 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.515311 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1440/2847] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 13:11:10.516511 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.522848 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:10.528557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f29e2-ec64-46f3-b46b-5d253df12c77 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.534000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.534932 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.535219 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.535498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] PATH_INFO: `/v3/projects/3346bec236bf4836bc3e0e60b693441f/users/8a92841d42c14dbfad34ff25114d67a6/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.537468 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3346bec236bf4836bc3e0e60b693441f, user_id=8a92841d42c14dbfad34ff25114d67a6, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.540140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.550588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1408/2848] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:10 2022] PUT /identity/v3/projects/3346bec236bf4836bc3e0e60b693441f/users/8a92841d42c14dbfad34ff25114d67a6/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:10.560812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.561287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.561393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.588219 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] MFA Rules not processed for user `8a92841d42c14dbfad34ff25114d67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:10.589437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:10.664010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1441/2849] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:10.676456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.678260 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:10.735705 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5a30c-80f6-4a7c-91aa-0e2ed23b6ef5 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.740285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.740930 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.741217 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.741498 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.750605 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.752025 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.762078 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1409/2850] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:10.805880 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:10.807301 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:10.820081 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9b902-7f03-4cc3-9269-60d813c86781 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:10.823828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:10.824467 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:10.824771 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:10.825045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:10.882630 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:10.884071 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9a3f-9693-4507-9c38-3608d4a829c5 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:10.892911 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1442/2851] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:14.140795 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:14.203739 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01e31-3afe-4870-a5a6-1ff89f2e1c8b service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:14.209306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:14.210218 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:14.210506 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:14.210783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] PATH_INFO: `/v3/users/10e38079d77141aabf72207de602fc18` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:14.211960 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e38079d77141aabf72207de602fc18)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:14.213977 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:14.264608 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e38079d77141aabf72207de602fc18'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.277866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e38079d77141aabf72207de602fc18'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.285341 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e38079d77141aabf72207de602fc18'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.294190 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e38079d77141aabf72207de602fc18'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.294826 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e38079d77141aabf72207de602fc18'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.301666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1410/2852] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:14 2022] DELETE /identity/v3/users/10e38079d77141aabf72207de602fc18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:14.306099 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:14.306598 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:14.306699 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:14.323922 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:14.325114 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:14.365895 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=100 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:14.386032 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1443/2853] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:14.396557 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:14.397972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:14.412782 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:14.459285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5302-1b26-43c9-852d-5209454a7f72 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:14.462895 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:14.463540 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:14.463822 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:14.464096 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:14.474147 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:14.475596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:14.485136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1411/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:14.757856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:14.759601 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:14.774579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6f3f-4810-4373-bc82-a1a77ae1ab3c None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:14.779915 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:14.780913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:14.781285 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:14.782274 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] PATH_INFO: `/v3/projects/2f9e0845d76c47108c94fa109c92aa8f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:14.784437 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9e0845d76c47108c94fa109c92aa8f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:14.786287 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:14.834805 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9e0845d76c47108c94fa109c92aa8f', 'request_id': 'req-53303838-e41e-45e5-a232-e68c83223cd6'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.840332 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9e0845d76c47108c94fa109c92aa8f', 'request_id': 'req-53303838-e41e-45e5-a232-e68c83223cd6'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.848526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9e0845d76c47108c94fa109c92aa8f', 'request_id': 'req-53303838-e41e-45e5-a232-e68c83223cd6'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.860002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] The token cache is being invalidate because project 2f9e0845d76c47108c94fa109c92aa8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:14.860294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.860929 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:14.863472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1444/2855] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:14 2022] DELETE /identity/v3/projects/2f9e0845d76c47108c94fa109c92aa8f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:14.867440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:14.876950 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5382-e120-4fef-af6f-9ab77e0f39c2 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:14.944060 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:14.944921 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:14.945197 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:14.945472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] PATH_INFO: `/v3/users/8a92841d42c14dbfad34ff25114d67a6` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:14.946660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a92841d42c14dbfad34ff25114d67a6)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:14.948590 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:14.994249 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a92841d42c14dbfad34ff25114d67a6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.006738 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a92841d42c14dbfad34ff25114d67a6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.013536 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a92841d42c14dbfad34ff25114d67a6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.021447 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a92841d42c14dbfad34ff25114d67a6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.022066 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-0d1585f6-2ce7-453e-93cd-294384a31d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a92841d42c14dbfad34ff25114d67a6'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.027814 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1412/2856] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:14 2022] DELETE /identity/v3/users/8a92841d42c14dbfad34ff25114d67a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:15.296920 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.298564 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:15.312056 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303838-e41e-45e5-a232-e68c83223cd6 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.371305 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.372167 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.372451 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.372726 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] PATH_INFO: `/v3/projects/3346bec236bf4836bc3e0e60b693441f` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.373934 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3346bec236bf4836bc3e0e60b693441f)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.375933 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.425712 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3346bec236bf4836bc3e0e60b693441f', 'request_id': 'req-f3dcdc69-bd87-4109-95b9-369545b423b0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.431435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3346bec236bf4836bc3e0e60b693441f', 'request_id': 'req-f3dcdc69-bd87-4109-95b9-369545b423b0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.438658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3346bec236bf4836bc3e0e60b693441f', 'request_id': 'req-f3dcdc69-bd87-4109-95b9-369545b423b0'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.446201 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:15.451678 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] The token cache is being invalidate because project 3346bec236bf4836bc3e0e60b693441f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:15.452154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.453188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-f3dcdc69-bd87-4109-95b9-369545b423b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:15.454918 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1445/2857] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:15 2022] DELETE /identity/v3/projects/3346bec236bf4836bc3e0e60b693441f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:15.460902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.461422 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.461523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.478965 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:15.480201 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:15.509332 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:15.542294 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1413/2858] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:15.549955 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.550340 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.550628 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.570443 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:15.571657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:15.579800 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1446/2859] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:15.584552 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.594300 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc620da-3a7c-47b6-bacf-d134eb529d94 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.599019 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.599672 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.599957 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.600238 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.600964 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:11:15.601273 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.603168 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.615002 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1414/2860] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:11:15.619208 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.628852 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a5a3-f680-483f-ab8a-09179007e22f None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.633478 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.634132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.634439 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.634714 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.635392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.637296 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.662546 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1447/2861] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:15 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:15.666586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.676662 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6253fb-b709-4723-a582-a83b3ab990cb admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.732636 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.733467 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.733755 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.734034 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.734751 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.736660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.756863 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1415/2862] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:15 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:15.761036 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.771354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc963c0-2f87-4abc-8f65-ed742aa6e021 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.776027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.776680 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.776964 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.777244 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.777965 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.779594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.790376 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1448/2863] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:15.794338 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.804745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a640-2645-4fde-bafa-559a4b57415d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.810404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.811059 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.811345 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.811621 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.812343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.813923 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e467b20-30ef-404a-a964-4a297e99783c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.825074 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1416/2864] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:15.829031 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:15.839012 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f797d-c8d8-482a-8bc8-76f1d17133a5 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:15.843784 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:15.844665 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.844950 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.845225 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] PATH_INFO: `/v3/projects/4ab6c3090c9844a78a76ffcfef95a9f1/users/aef1e66f3d0a409e81f10c7c4b81a203/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.860260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab6c3090c9844a78a76ffcfef95a9f1, user_id=aef1e66f3d0a409e81f10c7c4b81a203, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:15.863483 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:15.875942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1449/2865] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:15 2022] PUT /identity/v3/projects/4ab6c3090c9844a78a76ffcfef95a9f1/users/aef1e66f3d0a409e81f10c7c4b81a203/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:15.937488 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:15.937805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:15.938136 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:15.965140 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] MFA Rules not processed for user `aef1e66f3d0a409e81f10c7c4b81a203`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:15.966390 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:16.029717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1417/2866] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:16.034391 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.095322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540521dd-df67-4639-941a-2c34422ed3dc admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.100322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.100979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.101262 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.101818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.102550 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.104461 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.130936 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1450/2867] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:16 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:16.134866 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.146452 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd873f-c2cd-49ce-b874-9ed0f068cae9 None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.172310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:16.204435 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.205101 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.205387 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.205694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.206440 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.208320 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.230463 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1418/2868] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:16 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:16.234586 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.245596 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b44425-3745-48be-b30a-bcba6d2e4941 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.250199 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.250853 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.251139 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.251419 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.252148 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.254326 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.264916 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1451/2869] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:16.269645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.279439 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d18aa-37fa-4a5e-b29e-931fd747fd6a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.284064 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.284963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.285243 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.285523 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] PATH_INFO: `/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6/users/696b678150284748bc9b21259a2adb06/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.301617 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=960bd4ec241d44cfa9d2071f028fd7f6, user_id=696b678150284748bc9b21259a2adb06, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.304310 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.317712 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1419/2870] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:16 2022] PUT /identity/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6/users/696b678150284748bc9b21259a2adb06/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:16.321555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.332382 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7658-363d-469a-aa3c-89d0337d7a13 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.388141 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.388730 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.389010 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.389282 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.389999 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.391650 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915b341-7205-4aca-b98b-64e1070706f5 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.402350 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1452/2871] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:16.406572 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.417449 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3355c2-c15f-48ad-8bc9-d124f7a2ab3d admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.422174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.423068 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.423353 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.423629 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] PATH_INFO: `/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6/users/696b678150284748bc9b21259a2adb06/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.425645 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=960bd4ec241d44cfa9d2071f028fd7f6, user_id=696b678150284748bc9b21259a2adb06, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.428306 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.438631 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1420/2872] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:16 2022] PUT /identity/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6/users/696b678150284748bc9b21259a2adb06/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:16.449120 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.449408 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.449686 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.456981 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:16.477782 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] MFA Rules not processed for user `696b678150284748bc9b21259a2adb06`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:16.479021 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:16.545971 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1453/2873] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 13:11:16.558138 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:16.559839 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:16.616733 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501726-4c85-4c3f-b731-2c6079e2870f admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:16.620404 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:16.621050 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:16.621334 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:16.621614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:16.677490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:16.678888 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:16.694746 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1421/2874] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:18.032226 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:18.033685 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:18.045948 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a341-6e8c-42c4-b41b-660ccc7d8a1d None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:18.050054 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68d8d9ddbe0c4ebb920c126f0122ce33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:18.050736 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:18.051019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:18.051294 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:18.060203 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:18.061642 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff89d78-8814-4884-b67f-f428c66348c0 service cinder] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:18.071658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1454/2875] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:21.809206 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:21.848651 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:21.873905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820d169-c57f-46fc-8d30-ae8df0ff7c42 service cinder] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:21.878410 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:21.880388 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:21.880666 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:21.880938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] PATH_INFO: `/v3/users/aef1e66f3d0a409e81f10c7c4b81a203` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:21.882105 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef1e66f3d0a409e81f10c7c4b81a203)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:21.884036 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:21.929191 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef1e66f3d0a409e81f10c7c4b81a203'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:21.940946 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef1e66f3d0a409e81f10c7c4b81a203'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:21.949117 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef1e66f3d0a409e81f10c7c4b81a203'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:21.956077 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef1e66f3d0a409e81f10c7c4b81a203'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:21.956928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef1e66f3d0a409e81f10c7c4b81a203'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:21.962902 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1422/2876] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:21 2022] DELETE /identity/v3/users/aef1e66f3d0a409e81f10c7c4b81a203 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:21.967430 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:21.967902 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:21.968002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:21.985843 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:21.987066 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:22.045202 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1455/2877] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:22.055397 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:22.056805 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:22.116172 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191cf3-5228-4036-bb7f-63e58276a727 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:22.119878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:22.120535 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:22.120825 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:22.121104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:22.130565 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:22.131994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:22.141573 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1423/2878] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:22.431765 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:22.433277 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:22.446646 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a2a9-e271-418e-909a-0c5d76fc2bc7 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:22.451477 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:22.453072 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:22.453373 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:22.453653 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] PATH_INFO: `/v3/projects/4ab6c3090c9844a78a76ffcfef95a9f1` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:22.454877 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab6c3090c9844a78a76ffcfef95a9f1)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:22.456833 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:22.505037 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab6c3090c9844a78a76ffcfef95a9f1', 'request_id': 'req-770b6557-42c8-490a-a8c3-bfb6b9131251'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.510615 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab6c3090c9844a78a76ffcfef95a9f1', 'request_id': 'req-770b6557-42c8-490a-a8c3-bfb6b9131251'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.517740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab6c3090c9844a78a76ffcfef95a9f1', 'request_id': 'req-770b6557-42c8-490a-a8c3-bfb6b9131251'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.526062 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:22.530345 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] The token cache is being invalidate because project 4ab6c3090c9844a78a76ffcfef95a9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:22.531040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.531869 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.533775 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1456/2879] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:22 2022] DELETE /identity/v3/projects/4ab6c3090c9844a78a76ffcfef95a9f1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:22.538807 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:22.548407 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6daed3-2226-49a2-be04-d3068dc36d76 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:22.598009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:22.605737 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:22.606836 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:22.607297 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:22.607928 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] PATH_INFO: `/v3/users/696b678150284748bc9b21259a2adb06` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:22.609473 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696b678150284748bc9b21259a2adb06)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:22.611970 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:22.670881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696b678150284748bc9b21259a2adb06'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.683122 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696b678150284748bc9b21259a2adb06'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.690465 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696b678150284748bc9b21259a2adb06'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.698233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696b678150284748bc9b21259a2adb06'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.699024 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-b46eaa27-c59d-4b32-bfd4-1e9cd4a67c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696b678150284748bc9b21259a2adb06'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:22.705975 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1424/2880] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:11:22 2022] DELETE /identity/v3/users/696b678150284748bc9b21259a2adb06 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:22.973252 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:22.975238 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:22.988033 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6557-42c8-490a-a8c3-bfb6b9131251 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.046551 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.047411 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.047689 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.047979 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] PATH_INFO: `/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.049121 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960bd4ec241d44cfa9d2071f028fd7f6)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.051083 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.098322 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960bd4ec241d44cfa9d2071f028fd7f6', 'request_id': 'req-8ab63160-96bf-4a99-9c75-d66b8da669d8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:23.104333 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960bd4ec241d44cfa9d2071f028fd7f6', 'request_id': 'req-8ab63160-96bf-4a99-9c75-d66b8da669d8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:23.111575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960bd4ec241d44cfa9d2071f028fd7f6', 'request_id': 'req-8ab63160-96bf-4a99-9c75-d66b8da669d8'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:23.122984 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] The token cache is being invalidate because project 960bd4ec241d44cfa9d2071f028fd7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:11:23.123267 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:23.123883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-8ab63160-96bf-4a99-9c75-d66b8da669d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:11:23.125392 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1457/2881] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:11:22 2022] DELETE /identity/v3/projects/960bd4ec241d44cfa9d2071f028fd7f6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:23.131240 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7129-5770-445f-9a16-913b570029de None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.131745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7129-5770-445f-9a16-913b570029de None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.131856 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7129-5770-445f-9a16-913b570029de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.149852 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-4ade7129-5770-445f-9a16-913b570029de None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:23.151268 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-4ade7129-5770-445f-9a16-913b570029de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:23.210614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1425/2882] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:23.219474 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.219832 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.220174 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.238921 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:23.241215 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:23.248978 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1458/2883] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:23.253006 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7129-5770-445f-9a16-913b570029de None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.263343 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7129-5770-445f-9a16-913b570029de None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.267976 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.268622 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.268907 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.269183 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] PATH_INFO: `/v3/domains` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.269938 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 13:11:23.270501 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.272246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.283791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1426/2884] 10.222.0.36 () {58 vars in 1152 bytes} [Tue May 24 13:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 13:11:23.288492 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.298401 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e5705-47d1-4edb-b359-e82a780ce8f2 None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.303858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.304503 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.304786 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.305087 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.305764 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.307716 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.334883 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1459/2885] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:23 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:23.336644 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.346614 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1360a-47b3-4db2-8d9d-113812d68251 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.404296 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.404900 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.405189 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.405470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.406185 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.408103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.417418 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:23.430992 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1427/2886] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:23 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:23.434870 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.445425 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89042d-476f-4bcf-b763-9dbfa4340870 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.450002 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.450753 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.451043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.451318 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.452040 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.453636 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.464697 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1460/2887] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:23.468706 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.479413 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5590-327b-487e-afb3-2def7b4c4695 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.483999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.484649 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.484936 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.485215 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.485934 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.488518 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7825b-1ea0-42bf-aaf2-6d123750b2d9 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.498679 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1428/2888] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:23.502648 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.512494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f27dbd-4a75-4f56-8f3c-714ad5bdcfe2 admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.516998 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.517863 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.518176 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.518456 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] PATH_INFO: `/v3/projects/70cfa774a1f84eb88f4d032f7faa86bf/users/8c667715706c446bae29b2a3e0512c81/roles/1cb9e903cea946bbaf62dfaa5743dadb` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.533288 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cfa774a1f84eb88f4d032f7faa86bf, user_id=8c667715706c446bae29b2a3e0512c81, role_id=1cb9e903cea946bbaf62dfaa5743dadb)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.536521 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.549123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1461/2889] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:23 2022] PUT /identity/v3/projects/70cfa774a1f84eb88f4d032f7faa86bf/users/8c667715706c446bae29b2a3e0512c81/roles/1cb9e903cea946bbaf62dfaa5743dadb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:11:23.554864 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902261-41fa-4ee9-95ed-b598e1eb257f None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.555159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902261-41fa-4ee9-95ed-b598e1eb257f None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.555441 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902261-41fa-4ee9-95ed-b598e1eb257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.573661 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-65902261-41fa-4ee9-95ed-b598e1eb257f None None] MFA Rules not processed for user `99dd72bb591043628f61cab7bc928f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:23.574897 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-65902261-41fa-4ee9-95ed-b598e1eb257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:23.634375 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1429/2890] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:23.644028 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:23.645812 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:23.677270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:23.706314 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafbce-50d1-4e4e-a7d8-66622b84e4bd admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:23.710058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:23.710733 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:23.711022 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:23.711302 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:23.720330 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:23.721802 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:23.732404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1462/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:27.606574 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:27.607031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:27.607167 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:27.634713 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.auth.core [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] MFA Rules not processed for user `8c667715706c446bae29b2a3e0512c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:27.635876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:27.707241 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1430/2892] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:27.712571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:27.722664 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a765a9-56e5-460c-acda-78e24f0b029c service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:27.728914 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:27.729584 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:27.729903 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:27.730221 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] PATH_INFO: `/v3/projects` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:27.730932 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:27.732851 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:27.759809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1463/2893] 10.222.0.36 () {60 vars in 1152 bytes} [Tue May 24 13:11:27 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:27.763815 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:27.776116 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1441e2-2076-44da-957b-87bca8dfd03d None None] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:27.861178 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:27.861881 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] REQUEST_METHOD: `POST` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:27.862204 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:27.863148 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] PATH_INFO: `/v3/users` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:27.864496 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:27.866612 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:27.888901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1431/2894] 10.222.0.36 () {60 vars in 1143 bytes} [Tue May 24 13:11:27 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 13:11:27.892938 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:27.904675 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d34d0-5617-4cdb-8c50-d37e8a6c567a admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:27.909460 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:27.910258 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:27.910609 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:27.911576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:27.912487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:27.914138 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:27.926039 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1464/2895] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:27.930424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:27.937905 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:27.941790 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5350a-8874-4e29-9136-a4d8666c356c admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:27.947929 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:27.949020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:27.949490 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:27.949969 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] PATH_INFO: `/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba/users/f5a124c66fd64d30a0823acef86806f5/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:27.968281 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f026f3b9414044bc9a1d4eaf5eeeba, user_id=f5a124c66fd64d30a0823acef86806f5, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:27.971031 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:27.990456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1432/2896] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:27 2022] PUT /identity/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba/users/f5a124c66fd64d30a0823acef86806f5/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:27.999241 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:28.011534 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bc25-073c-4995-9a28-35ed23f7eccf admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:28.082023 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:28.083310 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:28.083606 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:28.083890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:28.084623 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:28.086279 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7fa9-2676-4f6d-b579-25174df4d74f admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:28.101850 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1465/2897] 10.222.0.36 () {58 vars in 1121 bytes} [Tue May 24 13:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 13:11:28.103461 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:28.114340 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9cd10-c5c4-4033-8111-776c6c2f4c76 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:28.119083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:28.119994 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:28.120285 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:28.120620 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] PATH_INFO: `/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba/users/f5a124c66fd64d30a0823acef86806f5/roles/5c9b5d36789c41e5a05dfad7f8753c41` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:28.122602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f026f3b9414044bc9a1d4eaf5eeeba, user_id=f5a124c66fd64d30a0823acef86806f5, role_id=5c9b5d36789c41e5a05dfad7f8753c41)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:28.125248 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:28.142159 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1433/2898] 10.222.0.36 () {60 vars in 1482 bytes} [Tue May 24 13:11:28 2022] PUT /identity/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba/users/f5a124c66fd64d30a0823acef86806f5/roles/5c9b5d36789c41e5a05dfad7f8753c41 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:11:32.620192 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27076-9854-47e5-993e-d8a9c52a7967 None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:32.621632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27076-9854-47e5-993e-d8a9c52a7967 None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:32.621632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27076-9854-47e5-993e-d8a9c52a7967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:32.667154 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-8dc27076-9854-47e5-993e-d8a9c52a7967 None None] MFA Rules not processed for user `f5a124c66fd64d30a0823acef86806f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:32.668380 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-8dc27076-9854-47e5-993e-d8a9c52a7967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:32.748839 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:32.780354 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1466/2899] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:32.798972 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:32.800876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:32.957377 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aba30-a41d-43ce-bd3e-dd2f59a94ff3 admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:32.966670 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:32.967602 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:32.967878 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:32.968156 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:33.046472 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:33.048873 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:33.060246 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1434/2900] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:33.987491 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] REQUEST_METHOD: `POST` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:33.988076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:33.988076 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:34.006321 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.auth.core [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] MFA Rules not processed for user `8c667715706c446bae29b2a3e0512c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 13:11:34.007524 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:34.014577 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1467/2901] 10.222.0.36 () {58 vars in 957 bytes} [Tue May 24 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 13:11:43.058694 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:44.000913 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=10 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:11:46.588717 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:46.590139 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:46.670901 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa468cd-04e4-4538-943a-c1a43648e779 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:46.674521 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:46.675163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:46.675442 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:46.675715 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:46.677555 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:46.688094 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:46.689499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:46.697841 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1435/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:48.149112 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:48.150600 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:48.221123 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b81ff-4788-4e8a-81f5-7d6b7cbba2da None None] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:48.228899 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:48.229621 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:48.230027 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:48.230388 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:48.232393 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:48.244692 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:48.246306 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:48.256185 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1468/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 13:11:49.871137 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:49.880722 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1704e87-968e-4dae-a7f5-c77b3c8c1bfb service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:49.884499 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:49.885153 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:49.885443 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:49.885723 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:49.887566 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:49.898990 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:49.900426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:49.909646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1436/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:50.631861 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:50.633947 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:50.650632 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3529a-943d-4e14-b4c0-fea5f644748f service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:50.657510 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:50.658667 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:50.659043 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:50.659565 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:50.661982 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:50.683810 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:50.685548 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:50.698019 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1469/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:56.572075 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:56.593370 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270f31-f4e0-4b12-8043-eb113d6a5618 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:56.599045 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:56.599697 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:56.599999 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:56.600265 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:56.602469 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:11:56.616054 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:56.618433 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:56.629949 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1437/2906] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:11:58.890946 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:11:58.901045 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f46d1-41ca-48e9-9305-d4b7967da01c service nova] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:11:58.904575 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:11:58.905206 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:11:58.905487 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:11:58.905762 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:11:58.914819 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:11:58.916260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:11:58.925856 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1470/2907] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:12:00.503683 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:12:00.518883 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370124-6bb8-4d65-adb2-e120cdbaec25 service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:12:00.525000 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0532ebb4e77b41179663accaa80e4942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:12:00.525660 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:12:00.525944 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:12:00.526267 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:12:00.528083 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:12:00.540792 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:12:00.542427 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:12:00.553104 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1438/2908] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:12:08.921694 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=44 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:12:10.548613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=53 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:14:07.247956 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:14:07.270299 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb5673-71a0-4a26-a482-7f5116b95f89 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:14:07.275276 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:14:07.275908 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:14:07.276194 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:14:07.276472 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:14:07.278264 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:14:07.304230 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:14:07.305827 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:14:07.316597 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1471/2909] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:14:08.085796 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:14:08.095486 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8157e5-7d73-4ba3-aa6b-3f833d57e6bc service nova] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:14:08.099517 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:14:08.100170 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:14:08.100456 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:14:08.100731 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:14:08.102665 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:14:08.113646 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:14:08.115103 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:14:08.123554 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1439/2910] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:14:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:14:08.206890 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:14:08.216233 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd995e2-3567-4625-b9be-f4f768e6d2d8 service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:14:08.220363 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:14:08.220997 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:14:08.221283 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:14:08.221562 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:14:08.223358 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:14:08.256434 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:14:08.257858 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:14:08.277571 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1472/2911] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:14:18.119596 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=6 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:14:18.275018 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=33 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:15:26.512575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:26.525253 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b507ed-ec4f-4571-a9f2-76cb74fdbd52 service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:26.529922 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:26.531710 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:26.532009 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:26.532280 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:26.534781 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:26.548749 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:26.550892 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:26.562222 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1440/2912] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:15:27.758547 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:27.767555 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98a2a-bf19-40d1-a1d3-c56ec439e04d service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:27.771614 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c9d6becc7f8440e88cc2a3a043ac824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:27.772260 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:27.772542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:27.772816 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:27.774809 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:27.789740 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:27.791222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:27.804181 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1473/2913] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:15:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:15:32.350560 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:32.364753 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f3fa-83d6-4156-ba2d-589752b6909f service neutron] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:32.371308 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:32.372076 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:32.372462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:32.372829 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:32.375126 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:32.389876 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:32.391709 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:32.404979 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1441/2914] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:15:35.439132 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:35.454494 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0ebf-6244-47d1-a02f-54b6b49116e2 service neutron] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:35.460527 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:35.461175 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] REQUEST_METHOD: `GET` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:35.461457 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:35.461734 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:35.463576 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:35.476497 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:35.478309 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:35.491594 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1474/2915] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:15:35.497362 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:35.591026 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4803-8c7c-484e-95ba-5d9750dee214 service placement] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:35.597255 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:35.598176 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:35.598470 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:35.598745 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] PATH_INFO: `/v3/users/8c667715706c446bae29b2a3e0512c81` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:35.599980 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c667715706c446bae29b2a3e0512c81)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:35.601935 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:35.651693 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c667715706c446bae29b2a3e0512c81'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.663774 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c667715706c446bae29b2a3e0512c81'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.671233 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c667715706c446bae29b2a3e0512c81'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.678963 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c667715706c446bae29b2a3e0512c81'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.679589 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c667715706c446bae29b2a3e0512c81'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.685383 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1442/2916] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:15:35 2022] DELETE /identity/v3/users/8c667715706c446bae29b2a3e0512c81 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 13:15:35.862579 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:35.873204 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ce159-48d5-4386-9c79-0f104aeb3bee service placement] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:35.931792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:35.932658 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:35.932943 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:35.933222 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] PATH_INFO: `/v3/projects/70cfa774a1f84eb88f4d032f7faa86bf` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:35.934435 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cfa774a1f84eb88f4d032f7faa86bf)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:35.936338 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:35.982542 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cfa774a1f84eb88f4d032f7faa86bf', 'request_id': 'req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.988188 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cfa774a1f84eb88f4d032f7faa86bf', 'request_id': 'req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:35.995724 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cfa774a1f84eb88f4d032f7faa86bf', 'request_id': 'req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.021526 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] The token cache is being invalidate because project 70cfa774a1f84eb88f4d032f7faa86bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:15:36.021818 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.022508 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.024214 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1475/2917] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:15:35 2022] DELETE /identity/v3/projects/70cfa774a1f84eb88f4d032f7faa86bf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:15:36.028163 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:36.029588 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:36.042937 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357d3db-3f0a-43db-851f-ffd924be5b3a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:36.076081 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:15:36.102305 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:36.103174 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:36.103462 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:36.103740 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] PATH_INFO: `/v3/users/f5a124c66fd64d30a0823acef86806f5` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:36.105020 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a124c66fd64d30a0823acef86806f5)` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:36.106956 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:36.155344 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a124c66fd64d30a0823acef86806f5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.167575 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a124c66fd64d30a0823acef86806f5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.175475 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a124c66fd64d30a0823acef86806f5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.182460 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a124c66fd64d30a0823acef86806f5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.183102 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.notifications [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a124c66fd64d30a0823acef86806f5'} {{(pid=80161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.188860 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1443/2918] 10.222.0.36 () {58 vars in 1223 bytes} [Tue May 24 13:15:36 2022] DELETE /identity/v3/users/f5a124c66fd64d30a0823acef86806f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:15:36.369375 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Authenticating user token {{(pid=80162) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:15:36.371186 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.fernet_utils [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:15:36.391041 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb09f-e12b-4cbb-9bcc-3d9ab3512d1d admin admin] Validating token access rules against request {{(pid=80162) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:15:36.440270 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:15:36.450404 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99dd72bb591043628f61cab7bc928f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6f1e0d8c1cd468ea817eb192b478192', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:15:36.451519 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:15:36.452015 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:15:36.452359 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] PATH_INFO: `/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba` {{(pid=80162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:15:36.453747 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f026f3b9414044bc9a1d4eaf5eeeba)` {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:15:36.456490 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] RBAC: Authorization granted {{(pid=80162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:15:36.501657 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f026f3b9414044bc9a1d4eaf5eeeba', 'request_id': 'req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.507792 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f026f3b9414044bc9a1d4eaf5eeeba', 'request_id': 'req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.515058 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f026f3b9414044bc9a1d4eaf5eeeba', 'request_id': 'req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2'} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.526656 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] The token cache is being invalidate because project f4f026f3b9414044bc9a1d4eaf5eeeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 13:15:36.526942 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.527561 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG keystone.notifications [None req-7888fccf-1e92-43b2-a1e4-dae194d7f4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 13:15:36.529085 dv-cinder-843018-2-smb devstack@keystone.service[80162]: [pid: 80162|app: 0|req: 1476/2919] 10.222.0.36 () {58 vars in 1232 bytes} [Tue May 24 13:15:36 2022] DELETE /identity/v3/projects/f4f026f3b9414044bc9a1d4eaf5eeeba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 13:15:46.185424 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:15:46.523828 dv-cinder-843018-2-smb devstack@keystone.service[80162]: DEBUG dbcounter [-] [80162] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:19:22.542870 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Authenticating user token {{(pid=80161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 13:19:22.544314 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:19:22.614099 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82b465-f6ad-46ba-b905-d628f6d21b5a admin admin] Validating token access rules against request {{(pid=80161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 13:19:22.673448 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e19685a3a9224caaba7399f5aa5a44f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53038747e0b48dab76c19f0e22732b1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 13:19:22.674030 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] REQUEST_METHOD: `GET` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 13:19:22.674349 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] SCRIPT_NAME: `/identity` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 13:19:22.674634 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 13:19:22.676426 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.fernet_utils [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 13:19:22.687613 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 13:19:22.689791 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb116923-2e7a-47ba-9be3-2a6dc7545ba4 service placement] RBAC: Authorization granted {{(pid=80161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 13:19:22.699783 dv-cinder-843018-2-smb devstack@keystone.service[80161]: [pid: 80161|app: 0|req: 1444/2920] 10.222.0.36 () {60 vars in 1365 bytes} [Tue May 24 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 13:19:32.695586 dv-cinder-843018-2-smb devstack@keystone.service[80161]: DEBUG dbcounter [-] [80161] Writing DB stats keystone:SELECT=58 {{(pid=80161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}